-- Logs begin at Fri 2022-05-27 12:58:01 UTC, end at Fri 2022-05-27 14:29:05 UTC. -- May 27 13:37:54.725827 dv-cinder-843018-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 27 13:37:54.736706 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 13:37:54 2022] *** May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: nodename: dv-cinder-843018-4-iscsi May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: machine: x86_64 May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: clock source: unix May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: pcre jit disabled May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: detected number of CPU cores: 4 May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: current working directory: / May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: detected binary path: /usr/bin/uwsgi-core May 27 13:37:54.738710 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: your processes number limit is 47680 May 27 13:37:54.739465 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: your memory page size is 4096 bytes May 27 13:37:54.739465 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: detected max file descriptor number: 2048 May 27 13:37:54.739465 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: lock engine: pthread robust mutexes May 27 13:37:54.739465 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: thunder lock: enabled May 27 13:37:54.739465 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 13:37:54.739465 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 13:37:54.786711 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: Python main interpreter initialized at 0x55cc9c4279c0 May 27 13:37:54.786711 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: python threads support enabled May 27 13:37:54.786711 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: your server socket listen backlog is limited to 100 connections May 27 13:37:54.786711 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: your mercy for graceful operations on workers is 90 seconds May 27 13:37:54.787173 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: mapped 403077 bytes (393 KB) for 2 cores May 27 13:37:54.787271 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: *** Operational MODE: preforking *** May 27 13:37:54.787486 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: *** uWSGI is running in multiple interpreter mode *** May 27 13:37:54.787486 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: spawned uWSGI master process (pid: 92052) May 27 13:37:54.787691 dv-cinder-843018-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 27 13:37:54.789689 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: spawned uWSGI worker 1 (pid: 92064, cores: 1) May 27 13:37:54.789689 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: spawned uWSGI worker 2 (pid: 92065, cores: 1) May 27 13:37:54.789689 dv-cinder-843018-4-iscsi devstack@keystone.service[92052]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 13:38:00.494086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 13:38:00.494086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: from cryptography.utils import int_from_bytes May 27 13:38:00.494890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 13:38:00.494890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: from cryptography.utils import int_from_bytes May 27 13:38:00.495055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 13:38:00.495055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: from cryptography.utils import int_from_bytes May 27 13:38:00.495510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 13:38:00.495510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: from cryptography.utils import int_from_bytes May 27 13:38:00.544016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 13:38:00.544182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 13:38:00.544969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] command line args: [] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 13:38:00.545073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 13:38:00.545203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 13:38:00.545395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 13:38:00.545546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] command line args: [] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 13:38:00.545641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ================================================================================ {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 13:38:00.545737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 13:38:00.545836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] admin_token = **** {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.545927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ================================================================================ {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 13:38:00.546269 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] config_dir = [] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.546358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] admin_token = **** {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.546443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.546522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] config_source = [] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.546598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] config_dir = [] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.546684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] debug = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.546763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.546840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.547096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] config_source = [] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.547096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] debug = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.547229 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.547372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.547482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.547589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.547670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.547740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.547845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.547989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.548079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] list_limit = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.548225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] log_config_append = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.548312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.548400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.548469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] list_limit = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.548604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] log_dir = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.548690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] log_config_append = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.548757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] log_file = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.548822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.548949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] log_dir = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.549030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.549097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] log_file = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.549223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.549312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.549424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.549559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.549671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.549800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.549882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.550012 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.550152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.550226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.550286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.550349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.550483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.550617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.550736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.550851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.550994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.551133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.551258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.551386 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.551510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.551633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.551757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.551880 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.551996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.552131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.552245 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.552362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.552484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.552595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.552720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] publish_errors = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.552860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.552997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.553126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] publish_errors = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.553249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.553355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.553477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.553599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.553715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.553839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.554041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.554168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.554555 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] standard_threads = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.554703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.554829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.554954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] standard_threads = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.555119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.555245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.555369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.555499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.555624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] use_journal = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.555742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.555865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] use_json = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.555989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] use_journal = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.556107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] use_stderr = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.556232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] use_json = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.556358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] use_syslog = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.556482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] use_stderr = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.556600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.556723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] use_syslog = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.556841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.557031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 13:38:00.557174 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.557294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.557411 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.557534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.557659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.557788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.557912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.558029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.558151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.558268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.558385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.558513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.558630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.558766 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.558883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.559023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.559168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.559373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.559500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.559624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.559741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.559857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.560016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.560198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.560388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.560584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.560761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.560891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.561011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.561140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.561258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.561381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.561500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.561632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.561751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.561880 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.561998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.562114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.562230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.562345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.562461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.562590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.562590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.562823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.562823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.563066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.563191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.563330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.563455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.563572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.563701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.563818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.563943 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.564049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.564147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.564251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.564354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.564460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.564569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.564669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.564766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.564862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.564966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.565084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.565210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.565357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.565476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.565599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.565718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.565835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.565960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.566072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.566189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.566305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.566422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.566545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.566671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.566789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.566910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.567055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.567183 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.567302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.567427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.567546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.567674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.567795 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.567912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.568035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.568153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.568282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.568401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.568526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.568645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.568769 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.568888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.569016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.569135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.569256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.569373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.569479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.569594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.569729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.569849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.569967 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.570090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.570209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.570325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.570450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.570568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.570685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.570808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.570934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.571079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.571214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.571333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.571450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.571566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.571683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.571806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.571933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.572053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.572159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.572274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.572466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.572592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.572719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.572837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.572969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.573089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.573213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.573331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.573448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.573573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.573691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.573808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.573924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.574042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.574168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.574286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.574403 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.574527 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.574652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.574770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.574899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.575049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.575183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.575303 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.575420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.575543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.575712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.575883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.576086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.576285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.576455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.576577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.576694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.576818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.576950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.577070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.577188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.577306 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.577424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.577541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.577667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.577785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.577902 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.578019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.578137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.578261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.578388 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.578508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.578632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.578750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.578867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.579054 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.579194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.579316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.579433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.579550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.579667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.579667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.579902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.580021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.580145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.580264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.580382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.580499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.580625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.580750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.580876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.580995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.581112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.581236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.581376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.581501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.581620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.581737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.581854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.581971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.582098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.582223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.582342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.582460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.582577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.582703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.582822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.582822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] auth.external = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.583059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.583177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.583293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] auth.external = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.583293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.583537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.583537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.583796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.583916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] auth.password = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.584041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.584166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] auth.token = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.584285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] auth.password = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.584413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.584551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] auth.token = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.584679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.584798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.584798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.585018 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.585018 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.585265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.585265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.585493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.585619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.585739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.585934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.586055 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.586173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] credential.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.586415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] credential.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.586533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.586659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.586778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.586778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.587016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.587136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.587254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.587395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.587520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.587638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.587764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.587883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.588000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.588126 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.588245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.588363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.588480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.588598 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.588715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.588843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.588962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.589080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.589197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.589314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.589432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.589557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.589677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.589795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.589913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.590030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] federation.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.590148 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.590274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.590393 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] federation.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.590510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.590627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.590744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.590871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.591033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.591155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.591777 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.591932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.592124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.592321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.592509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.592635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.592754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.592873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.592993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.593112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.593243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.593363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.593482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.593600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.593718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.593842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.593971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.594091 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.594210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.594335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.594455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.594582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.594701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.594819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.594938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.595078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.595197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.595327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.595447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.595565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.595682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.595807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.595933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.596065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.596186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.596304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.596422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.596539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.596657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.596783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.596783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.597012 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.597167 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.597294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.597414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.597541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.597660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.597778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.597896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.598021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.598141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.598273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.598392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.598511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.598511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.598730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.598847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.599032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.599155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.599275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.599393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.599510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.599628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.599759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.599887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.600006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.600131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.600249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.600369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.600495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.600614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.600731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.600849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.600966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.601083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.601214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.601214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.601438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.601555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.601672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.601789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.601915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.602034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.602151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.602268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.602386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.602503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.602629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.602748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.602865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.602999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.603129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.603249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.603378 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.603378 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.603601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.603718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.603835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.603835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.604062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.604181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.604298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.604298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.604519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.604636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.604761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.604761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.604983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.605100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.605217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.605217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.605444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.605564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.605682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.605799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.605916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.606042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.606161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.606161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.606381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.606498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.606617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.606617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.606871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.606871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.607850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.608051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.608226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.608359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.608481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.608608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.608730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.608730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.608951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.608951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.609181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.609181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.609402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.609402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.609629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.609629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.609863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.609863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.610083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.610201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.610319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.610509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.610631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.610749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.610868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.611050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.611173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.611304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.611425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.611543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.611661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.611779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.611898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.612025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.612145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.612145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.612366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.612366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.612586 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.612723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.612845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.612964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.613089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.613208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.613327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.613453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.613573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.613691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.613808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.613927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.614045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.614221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.614342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.614473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.614637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.614785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.614906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.615064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.615195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.615195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.615418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.615535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.615653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.615780 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.615900 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.616019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] resource.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.616137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.616256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.616373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] resource.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.616499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.616618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.616736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.616854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.616975 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.617096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.617222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.617342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.617460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.617578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.617696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.617813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.617939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.618066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.618186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.618304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.618422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] role.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.618540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.618679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] role.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.618799 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] role.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.618916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.619128 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] role.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.619249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.619366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.619498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.619619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.619737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.619855 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.619973 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.620100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.620228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.620347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.620465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.620583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.620583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.620812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.620931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.621049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.621049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.621270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.621270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.621497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.621616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.621734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.621851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.621969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.622087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.622213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.622334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.622476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.622613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.622803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.623022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.623236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.623372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.623493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.623612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.623730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.623849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.623976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.624097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.624230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.624349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.624470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.624589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.624716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.624836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.624955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.625073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.625192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.625319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.625439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.625559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.625678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.625796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.625915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.626041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.626162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.626281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.626399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.626518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.626637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.626763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.626883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.627055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.627176 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.627294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.627426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] token.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.627563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] token.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.627684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.627802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.627920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.628038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.628157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.628282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.628402 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.628521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.628640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.628758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.628876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.629003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.629003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.629225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.629344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.629462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.629580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.629712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.629832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.629950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.630069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.630200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.630319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.630457 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.630581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.630701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.630820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.630939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.630939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.631188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.631309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.631427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.631546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.631664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.631784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.connection = **** {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.631915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.connection = **** {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.632118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.632249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.632377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.632498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.632617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.632736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.632869 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.632991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.633119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.633240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.633358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.633477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.633595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.633714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.633841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.633962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.634081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.634199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.634318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.634437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.634563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.634683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.634802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.634922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.635086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.635205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.635337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.635468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.635588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.635706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.635824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.635944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.636071 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.636191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.636309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.636427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 13:38:00.636545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 13:38:00.636664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92064) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 13:38:00.661395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.661633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.661837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.662046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.662279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.662503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.671610 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.671973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.700250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.700470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.700676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.700768 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.753090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.753664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.804400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.804626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.805727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.805959 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.870913 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.871081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.871186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.871299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.871386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.871522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.871606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.871740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.871826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.871953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.872038 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.872163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.895684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.895799 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.895912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.896019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.896136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.896221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.896359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.896444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.896579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.896760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.896844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.896975 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.897065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.897186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.909108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.909203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.921953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.922178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.922401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.922621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.922838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.923078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.923292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92065) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.924012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.924245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.924470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.924690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.924917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.925120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.925333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92064) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 13:38:00.941758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.941932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.942033 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 13:38:00.942144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 13:38:00.942289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.942476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.942559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 13:38:00.942677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 13:38:00.942773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.942941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.943046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.943222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.943303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.943478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.943561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.943731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.955148 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.955277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.955420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.955526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.955684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.955771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.955956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.956040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.963968 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:00.964064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:00.967915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:00.968016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:00.968188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.968285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.968465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.968540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.968743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.968815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.969018 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.969140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.969271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.969514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.969595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.969783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.969903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.970054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.970171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.970322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.970443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.970593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.970707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.970856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.996766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.997001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.998621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:00.998900 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:00.999002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:00.999318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.004178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.004412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.004504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.004688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.004772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.005037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.011885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.012168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.012260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.012519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.017135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.017523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.017606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.017802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.017993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.018076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.018274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.018357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.018554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.018638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.018827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.018942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.019125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.019219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.019393 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.019657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.038026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.038458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.038697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.038991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.043096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.043604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.047023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.047316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.047651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.047940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.052288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.052965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.055864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.056536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.059623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.059938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.060225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.060459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.060545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.060757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.060841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.061031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.061122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.061322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.061596 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.061870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.080218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.080491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.080750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.081005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.081209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.081493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.081756 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.082013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.088910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.089906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.090596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.090867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.091667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.091940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.094103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.094380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.094653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.094927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.095138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.095222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.095419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.095695 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.095971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.096252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.109392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.109669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.109947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.110232 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.110327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.110508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.110593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.110779 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.110863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.111083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.111169 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.111363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.111630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.111906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.128947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.129926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.132168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.133153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.135458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.136434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.137043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.138021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.139353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.139672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.139949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.140595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.140877 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.141154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.147244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.148444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.148854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.150041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.152098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.152384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.152662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.152933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.153286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.153572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.154563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.154985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.162509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.162792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.163194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.163978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.164260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.164635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.171016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92065) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.171558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.171834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.172105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.172372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.172640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.172876 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92064) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 13:38:01.172961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.173152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.173239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.173430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.173514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.173693 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.173775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.173955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.174130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.174210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.174285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.174462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.174546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.174730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92065) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.174821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.175020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.175287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.175551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.175807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.176075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.176348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92064) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 13:38:01.214129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cc9c4279c0 pid: 92065 (default app) May 27 13:38:01.215804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cc9c4279c0 pid: 92064 (default app) May 27 13:38:01.217692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e25b1-daf0-451f-892a-d60a2e3a1f0d None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:01.217984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e25b1-daf0-451f-892a-d60a2e3a1f0d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:01.218259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e25b1-daf0-451f-892a-d60a2e3a1f0d None None] PATH_INFO: `/v3` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:01.222606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Fri May 27 13:38:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:10.460405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa6d4d-d411-4349-8900-5a534fc52d1c None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:10.460949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa6d4d-d411-4349-8900-5a534fc52d1c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:10.461037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa6d4d-d411-4349-8900-5a534fc52d1c None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:10.465515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:38:10.471565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:10.471956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:10.472103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:10.539288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: INFO dbcounter [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] Registered counter for database keystone May 27 13:38:10.560868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG oslo_db.sqlalchemy.engines [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 13:38:10.567099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writer thread running {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 13:38:10.750258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG passlib.handlers.bcrypt [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92065) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 13:38:10.750665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG passlib.handlers.bcrypt [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92065) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 13:38:10.805499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:10.807120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:10.931151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 27 13:38:11.128310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa6d4d-d411-4349-8900-5a534fc52d1c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:11.197402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: INFO dbcounter [None req-20aa6d4d-d411-4349-8900-5a534fc52d1c None None] Registered counter for database keystone May 27 13:38:11.217602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG oslo_db.sqlalchemy.engines [None req-20aa6d4d-d411-4349-8900-5a534fc52d1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92064) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 13:38:11.223893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writer thread running {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 13:38:11.344227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa6d4d-d411-4349-8900-5a534fc52d1c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:11.348517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc34cc-778c-4b41-a8c3-23c179b83b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:11.349168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc34cc-778c-4b41-a8c3-23c179b83b68 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:11.349449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc34cc-778c-4b41-a8c3-23c179b83b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:11.349724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc34cc-778c-4b41-a8c3-23c179b83b68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:11.357769 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc34cc-778c-4b41-a8c3-23c179b83b68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:11.409228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3dfc34cc-778c-4b41-a8c3-23c179b83b68 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 13:38:11.409508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc34cc-778c-4b41-a8c3-23c179b83b68 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:11.418986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Fri May 27 13:38:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 13:38:11.425679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:11.440234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f907-8c86-40ac-a45d-87f500e8a40d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:11.444643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385a4b6-5b76-4c40-aa48-ab8d8395155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:11.445807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385a4b6-5b76-4c40-aa48-ab8d8395155f admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:11.446094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385a4b6-5b76-4c40-aa48-ab8d8395155f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:11.446373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385a4b6-5b76-4c40-aa48-ab8d8395155f admin admin] PATH_INFO: `/v3/projects/a72e15fb71aa4010bb48da49b133708a` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:11.447904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385a4b6-5b76-4c40-aa48-ab8d8395155f admin admin] RBAC: Authorizing `identity:get_project(project_id=a72e15fb71aa4010bb48da49b133708a)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:11.607109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5385a4b6-5b76-4c40-aa48-ab8d8395155f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 13:38:11.607807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385a4b6-5b76-4c40-aa48-ab8d8395155f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:11.612213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Fri May 27 13:38:11 2022] GET /identity/v3/projects/a72e15fb71aa4010bb48da49b133708a => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:13.801749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601149b-7200-4afd-829f-8f4bfd5b5059 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:13.802291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601149b-7200-4afd-829f-8f4bfd5b5059 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:13.802291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601149b-7200-4afd-829f-8f4bfd5b5059 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:13.806415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:38:13.812729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145fa7b-948e-49de-b447-d5f11c4c0fbd None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:13.813156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145fa7b-948e-49de-b447-d5f11c4c0fbd None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:13.813310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145fa7b-948e-49de-b447-d5f11c4c0fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:13.832143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8145fa7b-948e-49de-b447-d5f11c4c0fbd None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:13.833662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8145fa7b-948e-49de-b447-d5f11c4c0fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:13.841853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 13:38:13.864643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601149b-7200-4afd-829f-8f4bfd5b5059 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:13.877082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601149b-7200-4afd-829f-8f4bfd5b5059 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:13.881200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73532a-1bd6-48a6-99b6-4816b340e3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:13.881818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73532a-1bd6-48a6-99b6-4816b340e3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:13.882100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73532a-1bd6-48a6-99b6-4816b340e3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:13.882374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73532a-1bd6-48a6-99b6-4816b340e3d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:13.890176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73532a-1bd6-48a6-99b6-4816b340e3d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:13.891973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73532a-1bd6-48a6-99b6-4816b340e3d1 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:13.900493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Fri May 27 13:38:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 13:38:13.906302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145fa7b-948e-49de-b447-d5f11c4c0fbd None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:13.915275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145fa7b-948e-49de-b447-d5f11c4c0fbd None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:13.920217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb086403-9671-4c32-9b65-68178671fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:13.921057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb086403-9671-4c32-9b65-68178671fe37 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:13.921642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb086403-9671-4c32-9b65-68178671fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:13.921874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb086403-9671-4c32-9b65-68178671fe37 admin admin] PATH_INFO: `/v3/users/4343916bc48d4b1596f21b7dfce5ddf4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:13.923296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb086403-9671-4c32-9b65-68178671fe37 admin admin] RBAC: Authorizing `identity:get_user(user_id=4343916bc48d4b1596f21b7dfce5ddf4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:13.925134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb086403-9671-4c32-9b65-68178671fe37 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:13.926689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Fri May 27 13:38:13 2022] GET /identity/v3/users/4343916bc48d4b1596f21b7dfce5ddf4 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:16.177243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fe6f-edb4-4286-b0d5-d223821adbe2 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:16.177867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fe6f-edb4-4286-b0d5-d223821adbe2 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:16.177867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001fe6f-edb4-4286-b0d5-d223821adbe2 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:16.179185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:16.184246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033d759-5bf1-4e8a-a0f9-c2d4ac5a234f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:16.184667 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033d759-5bf1-4e8a-a0f9-c2d4ac5a234f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:16.185367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033d759-5bf1-4e8a-a0f9-c2d4ac5a234f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:16.194000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe17695-35ef-435c-9d09-dcd229b58099 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:16.194287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe17695-35ef-435c-9d09-dcd229b58099 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:16.194564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe17695-35ef-435c-9d09-dcd229b58099 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:16.195908 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:38:16.201740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765028-54cd-412b-b219-b15092327035 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:16.202031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765028-54cd-412b-b219-b15092327035 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:16.202315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765028-54cd-412b-b219-b15092327035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:16.202562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3033d759-5bf1-4e8a-a0f9-c2d4ac5a234f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:16.203777 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3033d759-5bf1-4e8a-a0f9-c2d4ac5a234f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:16.241123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG passlib.handlers.bcrypt [None req-59765028-54cd-412b-b219-b15092327035 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92064) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 13:38:16.241550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG passlib.handlers.bcrypt [None req-59765028-54cd-412b-b219-b15092327035 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92064) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 13:38:16.284229 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:16.289379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-59765028-54cd-412b-b219-b15092327035 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:16.290956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-59765028-54cd-412b-b219-b15092327035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:16.306832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033d759-5bf1-4e8a-a0f9-c2d4ac5a234f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:16.332234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:16.394501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:16.412219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033d759-5bf1-4e8a-a0f9-c2d4ac5a234f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:16.416941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765028-54cd-412b-b219-b15092327035 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:16.447343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac31f2a-2d84-4b73-b22a-2f93a2fa0772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:16.448071 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac31f2a-2d84-4b73-b22a-2f93a2fa0772 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:16.448365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac31f2a-2d84-4b73-b22a-2f93a2fa0772 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:16.448642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac31f2a-2d84-4b73-b22a-2f93a2fa0772 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:16.461628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac31f2a-2d84-4b73-b22a-2f93a2fa0772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-eac31f2a-2d84-4b73-b22a-2f93a2fa0772 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:16.473840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:16.474868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:16.475676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:38:16.481300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac31f2a-2d84-4b73-b22a-2f93a2fa0772 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:16.568989 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:16.587468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac31f2a-2d84-4b73-b22a-2f93a2fa0772 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:16.622626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f2f5-fe87-4248-8101-e06b833daee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:16.623353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f2f5-fe87-4248-8101-e06b833daee3 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:16.623638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f2f5-fe87-4248-8101-e06b833daee3 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:16.623914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f2f5-fe87-4248-8101-e06b833daee3 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:16.624670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8f2f5-fe87-4248-8101-e06b833daee3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:16.624979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8f2f5-fe87-4248-8101-e06b833daee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:16.626376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8f2f5-fe87-4248-8101-e06b833daee3 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:16.631201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765028-54cd-412b-b219-b15092327035 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:16.633495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:16.638441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:16.644490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f2f5-fe87-4248-8101-e06b833daee3 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:16.670689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca12b3-3bed-4b1d-ada1-396bc94903e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:16.672147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca12b3-3bed-4b1d-ada1-396bc94903e5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:16.672847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca12b3-3bed-4b1d-ada1-396bc94903e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:16.672847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca12b3-3bed-4b1d-ada1-396bc94903e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:16.742146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca12b3-3bed-4b1d-ada1-396bc94903e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:16.743703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca12b3-3bed-4b1d-ada1-396bc94903e5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:16.745302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f2f5-fe87-4248-8101-e06b833daee3 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:16.778939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98215870-a1ec-4e13-840c-51c479b6ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:16.779910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215870-a1ec-4e13-840c-51c479b6ab32 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:16.780193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215870-a1ec-4e13-840c-51c479b6ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:16.780471 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215870-a1ec-4e13-840c-51c479b6ab32 None admin] PATH_INFO: `/v3/users/4343916bc48d4b1596f21b7dfce5ddf4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:16.781689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98215870-a1ec-4e13-840c-51c479b6ab32 None admin] RBAC: Authorizing `identity:get_user(user_id=4343916bc48d4b1596f21b7dfce5ddf4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:16.783203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98215870-a1ec-4e13-840c-51c479b6ab32 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:16.784816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:16 2022] GET /identity/v3/users/4343916bc48d4b1596f21b7dfce5ddf4 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:16.790231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98215870-a1ec-4e13-840c-51c479b6ab32 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:16.805593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:16.849745 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 13:38:16.855251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca12b3-3bed-4b1d-ada1-396bc94903e5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:16.858708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:16.891651 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98215870-a1ec-4e13-840c-51c479b6ab32 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:16.926398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea15c7e-e81d-464a-b1a7-891f4a5935a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:16.927233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15c7e-e81d-464a-b1a7-891f4a5935a1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:16.927522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15c7e-e81d-464a-b1a7-891f4a5935a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:16.927798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15c7e-e81d-464a-b1a7-891f4a5935a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:16.928979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea15c7e-e81d-464a-b1a7-891f4a5935a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:16.930489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea15c7e-e81d-464a-b1a7-891f4a5935a1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:16.932123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:16.938665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea15c7e-e81d-464a-b1a7-891f4a5935a1 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:16.956278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca12b3-3bed-4b1d-ada1-396bc94903e5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:16.997138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b8ea2-916c-4908-9114-9e7c5a2ad7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:16.998561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8ea2-916c-4908-9114-9e7c5a2ad7d8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:16.998813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8ea2-916c-4908-9114-9e7c5a2ad7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:16.999209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4b8ea2-916c-4908-9114-9e7c5a2ad7d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:17.019748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b8ea2-916c-4908-9114-9e7c5a2ad7d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:17.021229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4b8ea2-916c-4908-9114-9e7c5a2ad7d8 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:17.021665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:17.042098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea15c7e-e81d-464a-b1a7-891f4a5935a1 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-5f4b8ea2-916c-4908-9114-9e7c5a2ad7d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:38:17.042810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:17.043817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:17.047823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:38:17.047823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:38:17.047823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:38:17.047823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:17.047823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:38:17.050293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b8ea2-916c-4908-9114-9e7c5a2ad7d8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:17.082466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20255c24-1151-4302-862a-c7321a686d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:17.083320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255c24-1151-4302-862a-c7321a686d5c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:17.083787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255c24-1151-4302-862a-c7321a686d5c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:17.084134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20255c24-1151-4302-862a-c7321a686d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:17.085261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20255c24-1151-4302-862a-c7321a686d5c None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.domain.id=default, user.id=4343916bc48d4b1596f21b7dfce5ddf4) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:17.085679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20255c24-1151-4302-862a-c7321a686d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:17.087615 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20255c24-1151-4302-862a-c7321a686d5c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:17.097056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Fri May 27 13:38:16 2022] GET /identity/v3/role_assignments?user.id=4343916bc48d4b1596f21b7dfce5ddf4&scope.domain.id=default&role.id=3951cc86a51d416fafc5676d456e79ce => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:17.126383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:17.176755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4b8ea2-916c-4908-9114-9e7c5a2ad7d8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:17.216268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a48811-27a6-49d4-8143-4e601c87649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:17.216955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48811-27a6-49d4-8143-4e601c87649b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:17.217257 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48811-27a6-49d4-8143-4e601c87649b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:17.217516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a48811-27a6-49d4-8143-4e601c87649b None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:17.218265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a48811-27a6-49d4-8143-4e601c87649b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:17.218577 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a48811-27a6-49d4-8143-4e601c87649b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:17.220059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a48811-27a6-49d4-8143-4e601c87649b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:17.240962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:19.645358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7eaab-d66b-44f8-a808-9da09c21513a None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:19.645920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7eaab-d66b-44f8-a808-9da09c21513a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:19.645992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7eaab-d66b-44f8-a808-9da09c21513a None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:19.647343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:19.665090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b0d93-2979-4797-ab12-eb0896f482a4 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:19.665610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b0d93-2979-4797-ab12-eb0896f482a4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:19.665685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b0d93-2979-4797-ab12-eb0896f482a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:19.696035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-4d4b0d93-2979-4797-ab12-eb0896f482a4 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:19.697268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4d4b0d93-2979-4797-ab12-eb0896f482a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:19.789902 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:19.836481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7eaab-d66b-44f8-a808-9da09c21513a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:19.932660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1238b6e-b4f0-44bb-896c-d6a4da847a9e None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:19.932941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1238b6e-b4f0-44bb-896c-d6a4da847a9e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:19.933149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1238b6e-b4f0-44bb-896c-d6a4da847a9e None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:19.935450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:19.953396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689138c6-b944-41ef-99cd-83fa00625c59 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:19.953697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689138c6-b944-41ef-99cd-83fa00625c59 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:19.953963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689138c6-b944-41ef-99cd-83fa00625c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:19.976164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7eaab-d66b-44f8-a808-9da09c21513a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:19.993384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-689138c6-b944-41ef-99cd-83fa00625c59 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:19.994644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-689138c6-b944-41ef-99cd-83fa00625c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:20.062867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc3e8b-574f-4e1e-9c33-2369361ca00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:20.063711 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3e8b-574f-4e1e-9c33-2369361ca00a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:20.064004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3e8b-574f-4e1e-9c33-2369361ca00a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:20.064282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc3e8b-574f-4e1e-9c33-2369361ca00a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:20.086241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:20.092823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc3e8b-574f-4e1e-9c33-2369361ca00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-1fdc3e8b-574f-4e1e-9c33-2369361ca00a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:20.100887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:20.101773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:20.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:20.109857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 13/25] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:38:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:20.114143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d1d78-5e30-48be-8500-cab9ff74508b None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:20.114143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d1d78-5e30-48be-8500-cab9ff74508b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:20.114143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d1d78-5e30-48be-8500-cab9ff74508b None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:20.114143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 14/26] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:20.122825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d1d78-5e30-48be-8500-cab9ff74508b None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:20.130772 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:20.160507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:20.161818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708e3b5-8618-4cb3-ad6d-d5edd7f978e0 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:20.162114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708e3b5-8618-4cb3-ad6d-d5edd7f978e0 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:20.162391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708e3b5-8618-4cb3-ad6d-d5edd7f978e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:20.194348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-6708e3b5-8618-4cb3-ad6d-d5edd7f978e0 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:20.195428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6708e3b5-8618-4cb3-ad6d-d5edd7f978e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:20.330535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 14/28] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:20.331397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708e3b5-8618-4cb3-ad6d-d5edd7f978e0 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:20.332389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d1d78-5e30-48be-8500-cab9ff74508b None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:20.377645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a4237-795a-4762-b20c-7e5cfe1dc807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:20.378447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a4237-795a-4762-b20c-7e5cfe1dc807 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:20.378737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a4237-795a-4762-b20c-7e5cfe1dc807 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:20.379049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a4237-795a-4762-b20c-7e5cfe1dc807 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:20.379840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a4237-795a-4762-b20c-7e5cfe1dc807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:20.380151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a4237-795a-4762-b20c-7e5cfe1dc807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:20.381720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a4237-795a-4762-b20c-7e5cfe1dc807 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:20.392463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 15/29] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:20.393924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9317e-e3cf-41b8-8e38-d5455f63f188 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:20.394212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9317e-e3cf-41b8-8e38-d5455f63f188 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:20.394492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9317e-e3cf-41b8-8e38-d5455f63f188 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:20.399747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:20.399747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9317e-e3cf-41b8-8e38-d5455f63f188 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:20.463981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708e3b5-8618-4cb3-ad6d-d5edd7f978e0 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:20.473306 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:20.473462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:20.501951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0eb4bc-8c8f-4a6f-ae31-33514243efb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:20.502986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eb4bc-8c8f-4a6f-ae31-33514243efb4 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:20.503480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eb4bc-8c8f-4a6f-ae31-33514243efb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:20.503953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eb4bc-8c8f-4a6f-ae31-33514243efb4 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:20.504894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0eb4bc-8c8f-4a6f-ae31-33514243efb4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:20.506503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0eb4bc-8c8f-4a6f-ae31-33514243efb4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:20.510082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9317e-e3cf-41b8-8e38-d5455f63f188 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:20.545453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc7951-451d-48b2-bd57-49c4c1d821be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:20.546250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc7951-451d-48b2-bd57-49c4c1d821be None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:20.546776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc7951-451d-48b2-bd57-49c4c1d821be None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:20.547085 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddc7951-451d-48b2-bd57-49c4c1d821be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:20.558262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc7951-451d-48b2-bd57-49c4c1d821be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:20.560339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddc7951-451d-48b2-bd57-49c4c1d821be None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-7ddc7951-451d-48b2-bd57-49c4c1d821be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:38:20.579207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:20.580025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:20.581309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:38:20.581309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:38:20.581309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:38:20.581309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:20.581309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 17/31] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:20.581309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc7951-451d-48b2-bd57-49c4c1d821be None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:20.709198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddc7951-451d-48b2-bd57-49c4c1d821be None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:20.729102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:20.749337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2248b7-3606-41ae-adff-fe1185865269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:20.750354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2248b7-3606-41ae-adff-fe1185865269 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:20.750558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2248b7-3606-41ae-adff-fe1185865269 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:20.750844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2248b7-3606-41ae-adff-fe1185865269 None admin] PATH_INFO: `/v3/users/4343916bc48d4b1596f21b7dfce5ddf4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:20.752130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2248b7-3606-41ae-adff-fe1185865269 None admin] RBAC: Authorizing `identity:get_user(user_id=4343916bc48d4b1596f21b7dfce5ddf4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:20.753809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2248b7-3606-41ae-adff-fe1185865269 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:20.755329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 15/32] 10.222.0.42 () {60 vars in 1131 bytes} [Fri May 27 13:38:20 2022] POST /identity/v3/roles => generated 219 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:38:20.755892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 18/33] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:20 2022] GET /identity/v3/users/4343916bc48d4b1596f21b7dfce5ddf4 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:20.756326 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2248b7-3606-41ae-adff-fe1185865269 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:20.756853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342810a2-3c53-41c8-be7e-819b68c0c3a1 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:20.757152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342810a2-3c53-41c8-be7e-819b68c0c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:20.757408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342810a2-3c53-41c8-be7e-819b68c0c3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:20.779282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-342810a2-3c53-41c8-be7e-819b68c0c3a1 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:20.780850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-342810a2-3c53-41c8-be7e-819b68c0c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:20.897527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 16/34] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:20.898418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342810a2-3c53-41c8-be7e-819b68c0c3a1 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:20.986849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2248b7-3606-41ae-adff-fe1185865269 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:21.023413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:21.028045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342810a2-3c53-41c8-be7e-819b68c0c3a1 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:21.057408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905af54-899a-4d9d-9c01-98d8769692b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:21.058087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905af54-899a-4d9d-9c01-98d8769692b7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.058371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905af54-899a-4d9d-9c01-98d8769692b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.058641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905af54-899a-4d9d-9c01-98d8769692b7 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.059418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905af54-899a-4d9d-9c01-98d8769692b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:21.059750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905af54-899a-4d9d-9c01-98d8769692b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:21.061692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905af54-899a-4d9d-9c01-98d8769692b7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:21.070372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774767e-68d3-42d9-8de4-91c48a08803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:21.071201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774767e-68d3-42d9-8de4-91c48a08803d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.071488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774767e-68d3-42d9-8de4-91c48a08803d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.071766 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774767e-68d3-42d9-8de4-91c48a08803d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.073291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774767e-68d3-42d9-8de4-91c48a08803d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:21.074887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774767e-68d3-42d9-8de4-91c48a08803d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:21.079264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 17/35] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:21.083254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774767e-68d3-42d9-8de4-91c48a08803d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:21.086796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 19/36] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:21.090132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905af54-899a-4d9d-9c01-98d8769692b7 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:21.155620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:21.215005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774767e-68d3-42d9-8de4-91c48a08803d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:21.226092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905af54-899a-4d9d-9c01-98d8769692b7 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:21.266155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206b63a-ccdc-44e5-a533-5b67dfd870b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:21.266155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206b63a-ccdc-44e5-a533-5b67dfd870b9 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.266405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206b63a-ccdc-44e5-a533-5b67dfd870b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.266473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206b63a-ccdc-44e5-a533-5b67dfd870b9 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.267973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206b63a-ccdc-44e5-a533-5b67dfd870b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:21.268659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206b63a-ccdc-44e5-a533-5b67dfd870b9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:21.284304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916b434-f8aa-45ca-a700-23f73cad8e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:21.285502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916b434-f8aa-45ca-a700-23f73cad8e99 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.290381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916b434-f8aa-45ca-a700-23f73cad8e99 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.290381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916b434-f8aa-45ca-a700-23f73cad8e99 None admin] PATH_INFO: `/v3/domains/default/users/4343916bc48d4b1596f21b7dfce5ddf4/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.290381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916b434-f8aa-45ca-a700-23f73cad8e99 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4343916bc48d4b1596f21b7dfce5ddf4, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:21.290381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916b434-f8aa-45ca-a700-23f73cad8e99 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:21.371823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1131 bytes} [Fri May 27 13:38:21 2022] POST /identity/v3/roles => generated 225 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:38:21.373229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206b63a-ccdc-44e5-a533-5b67dfd870b9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:21.421856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:21.509734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 20/38] 10.222.0.42 () {58 vars in 1361 bytes} [Fri May 27 13:38:21 2022] PUT /identity/v3/domains/default/users/4343916bc48d4b1596f21b7dfce5ddf4/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:38:21.511691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a0f0b-c3b6-463a-a9d4-d08bf4eeb036 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.511991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a0f0b-c3b6-463a-a9d4-d08bf4eeb036 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.512276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a0f0b-c3b6-463a-a9d4-d08bf4eeb036 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.516127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206b63a-ccdc-44e5-a533-5b67dfd870b9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:21.517250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 21/39] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:21.523020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec711-2cfb-4c42-aa6b-0e192dd77618 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.523342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec711-2cfb-4c42-aa6b-0e192dd77618 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.523617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ec711-2cfb-4c42-aa6b-0e192dd77618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.543132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-121ec711-2cfb-4c42-aa6b-0e192dd77618 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:21.545641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-121ec711-2cfb-4c42-aa6b-0e192dd77618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:21.568797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd2232-9f85-4437-b404-c14d554e6d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:21.570642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd2232-9f85-4437-b404-c14d554e6d11 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.571229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd2232-9f85-4437-b404-c14d554e6d11 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.571993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd2232-9f85-4437-b404-c14d554e6d11 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.573233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd2232-9f85-4437-b404-c14d554e6d11 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:21.576329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd2232-9f85-4437-b404-c14d554e6d11 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:21.633778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 22/40] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:21.635309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4080cbc-af1c-4368-aac6-e7da999df5c7 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.635609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4080cbc-af1c-4368-aac6-e7da999df5c7 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.635894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4080cbc-af1c-4368-aac6-e7da999df5c7 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.637270 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 23/41] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:21.643623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aacd4-9411-47d2-8bdb-1946b2a4200e None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.643920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aacd4-9411-47d2-8bdb-1946b2a4200e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.644193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393aacd4-9411-47d2-8bdb-1946b2a4200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.669975 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-393aacd4-9411-47d2-8bdb-1946b2a4200e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:21.671272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-393aacd4-9411-47d2-8bdb-1946b2a4200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:21.707946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:21.725670 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 19/42] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:38:21 2022] POST /identity/v3/projects => generated 301 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:38:21.726672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd2232-9f85-4437-b404-c14d554e6d11 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:21.761430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 24/43] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:21.786488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aacd4-9411-47d2-8bdb-1946b2a4200e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:21.840272 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:21.873973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd2232-9f85-4437-b404-c14d554e6d11 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:21.925805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393aacd4-9411-47d2-8bdb-1946b2a4200e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:21.926098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43844d5d-902a-49bb-a139-795022964cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:21.926997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43844d5d-902a-49bb-a139-795022964cc4 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.927432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43844d5d-902a-49bb-a139-795022964cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.927527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43844d5d-902a-49bb-a139-795022964cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.928389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43844d5d-902a-49bb-a139-795022964cc4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:21.930647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43844d5d-902a-49bb-a139-795022964cc4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:21.972877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ea1a5-7f87-4405-8344-d3aa2dddad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:21.973732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ea1a5-7f87-4405-8344-d3aa2dddad51 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:21.974048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ea1a5-7f87-4405-8344-d3aa2dddad51 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:21.974300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ea1a5-7f87-4405-8344-d3aa2dddad51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:21.975612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ea1a5-7f87-4405-8344-d3aa2dddad51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:21.977253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565ea1a5-7f87-4405-8344-d3aa2dddad51 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:21.978893 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 25/44] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:21.984388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ea1a5-7f87-4405-8344-d3aa2dddad51 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:22.020642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:22.086041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ea1a5-7f87-4405-8344-d3aa2dddad51 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:22.093597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 20/45] 10.222.0.42 () {60 vars in 1131 bytes} [Fri May 27 13:38:21 2022] POST /identity/v3/roles => generated 223 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:38:22.123782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9e380-6707-4af3-9610-3ed8cd073d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:22.124482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9e380-6707-4af3-9610-3ed8cd073d6f None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:22.124771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9e380-6707-4af3-9610-3ed8cd073d6f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:22.125050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9e380-6707-4af3-9610-3ed8cd073d6f None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:22.125807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9e380-6707-4af3-9610-3ed8cd073d6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:22.127346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9e380-6707-4af3-9610-3ed8cd073d6f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:22.269053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 26/46] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:38:21 2022] POST /identity/v3/projects => generated 312 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:38:23.833823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331a64b-aa84-49b3-b31d-4164983812b5 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:23.834387 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331a64b-aa84-49b3-b31d-4164983812b5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:23.834387 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331a64b-aa84-49b3-b31d-4164983812b5 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:23.835811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 21/47] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:23.841643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d66d-cce9-43f0-a93b-b17b5628fa54 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:23.842060 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d66d-cce9-43f0-a93b-b17b5628fa54 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:23.842216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d66d-cce9-43f0-a93b-b17b5628fa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:23.859370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3574d66d-cce9-43f0-a93b-b17b5628fa54 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:23.860550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3574d66d-cce9-43f0-a93b-b17b5628fa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:23.927866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 27/48] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:23.951627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331a64b-aa84-49b3-b31d-4164983812b5 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:24.055294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331a64b-aa84-49b3-b31d-4164983812b5 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:24.088933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd94b2-9772-43a2-9420-c5fe8a1d6d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:24.089735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd94b2-9772-43a2-9420-c5fe8a1d6d96 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:24.090049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd94b2-9772-43a2-9420-c5fe8a1d6d96 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:24.090334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd94b2-9772-43a2-9420-c5fe8a1d6d96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:24.094835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:24.103266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd94b2-9772-43a2-9420-c5fe8a1d6d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-f4fd94b2-9772-43a2-9420-c5fe8a1d6d96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:24.112630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:24.115429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:24.116172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 22/49] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:24.119920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d66d-cce9-43f0-a93b-b17b5628fa54 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:24.137199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:24.220499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d66d-cce9-43f0-a93b-b17b5628fa54 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:24.255799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f718d5-d326-4077-94f7-6ee654de01af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:24.256562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f718d5-d326-4077-94f7-6ee654de01af None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:24.256855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f718d5-d326-4077-94f7-6ee654de01af None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:24.257160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f718d5-d326-4077-94f7-6ee654de01af None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:24.257923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f718d5-d326-4077-94f7-6ee654de01af None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:24.258240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f718d5-d326-4077-94f7-6ee654de01af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:24.259682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f718d5-d326-4077-94f7-6ee654de01af None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:24.268621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 28/50] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:24.274635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd94b2-9772-43a2-9420-c5fe8a1d6d96 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:24.383787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd94b2-9772-43a2-9420-c5fe8a1d6d96 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:24.417174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30256a2f-57ef-4eb0-8097-0147d01d3104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:24.418050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30256a2f-57ef-4eb0-8097-0147d01d3104 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:24.418340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30256a2f-57ef-4eb0-8097-0147d01d3104 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:24.418621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30256a2f-57ef-4eb0-8097-0147d01d3104 None admin] PATH_INFO: `/v3/users/4343916bc48d4b1596f21b7dfce5ddf4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:24.421034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30256a2f-57ef-4eb0-8097-0147d01d3104 None admin] RBAC: Authorizing `identity:get_user(user_id=4343916bc48d4b1596f21b7dfce5ddf4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:24.422761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30256a2f-57ef-4eb0-8097-0147d01d3104 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:24.424437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 23/51] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:24 2022] GET /identity/v3/users/4343916bc48d4b1596f21b7dfce5ddf4 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:24.429801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f718d5-d326-4077-94f7-6ee654de01af None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:24.477232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55101da2-656d-43b8-b8ff-8ce81ff3a0a1 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:24.477542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55101da2-656d-43b8-b8ff-8ce81ff3a0a1 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:24.477892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55101da2-656d-43b8-b8ff-8ce81ff3a0a1 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:24.479308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 24/52] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:38:24.484984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6425a-230c-4e44-9da3-f15759d9f4a6 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:24.485279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6425a-230c-4e44-9da3-f15759d9f4a6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:24.485563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6425a-230c-4e44-9da3-f15759d9f4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:24.502360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-9be6425a-230c-4e44-9da3-f15759d9f4a6 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:24.503593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9be6425a-230c-4e44-9da3-f15759d9f4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:24.510313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:24.532094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f718d5-d326-4077-94f7-6ee654de01af None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:24.563231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:24.567845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642c8a0-10b3-4fb3-9e64-bbc1fdeec42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:24.568641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c8a0-10b3-4fb3-9e64-bbc1fdeec42f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:24.568926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c8a0-10b3-4fb3-9e64-bbc1fdeec42f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:24.569204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642c8a0-10b3-4fb3-9e64-bbc1fdeec42f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:24.570362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642c8a0-10b3-4fb3-9e64-bbc1fdeec42f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:24.571026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 25/53] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:24.571867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1642c8a0-10b3-4fb3-9e64-bbc1fdeec42f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:24.574995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 29/54] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:24.580031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6425a-230c-4e44-9da3-f15759d9f4a6 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:24.599212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642c8a0-10b3-4fb3-9e64-bbc1fdeec42f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:24.682224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6425a-230c-4e44-9da3-f15759d9f4a6 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:24.696278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642c8a0-10b3-4fb3-9e64-bbc1fdeec42f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:24.717070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067c64-9de9-4acb-a46c-e999f21affe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:24.717727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067c64-9de9-4acb-a46c-e999f21affe2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:24.718014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067c64-9de9-4acb-a46c-e999f21affe2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:24.718291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067c64-9de9-4acb-a46c-e999f21affe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:24.719236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067c64-9de9-4acb-a46c-e999f21affe2 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.domain.id=default, user.id=4343916bc48d4b1596f21b7dfce5ddf4) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:24.719546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067c64-9de9-4acb-a46c-e999f21affe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:24.720994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067c64-9de9-4acb-a46c-e999f21affe2 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:24.729506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 26/55] 10.222.0.42 () {56 vars in 1322 bytes} [Fri May 27 13:38:24 2022] GET /identity/v3/role_assignments?user.id=4343916bc48d4b1596f21b7dfce5ddf4&scope.domain.id=default&role.id=3951cc86a51d416fafc5676d456e79ce => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:24.729947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82695606-4e98-468e-b5a4-b890150f48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:24.730749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82695606-4e98-468e-b5a4-b890150f48bc None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:24.731074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82695606-4e98-468e-b5a4-b890150f48bc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:24.731354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82695606-4e98-468e-b5a4-b890150f48bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:24.733143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82695606-4e98-468e-b5a4-b890150f48bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:24.734654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82695606-4e98-468e-b5a4-b890150f48bc None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:24.736384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 30/56] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:24.742226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067c64-9de9-4acb-a46c-e999f21affe2 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:24.807895 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:24.852141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067c64-9de9-4acb-a46c-e999f21affe2 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:24.886612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ca3c3-05ff-4ae0-921e-c8de67e8a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:24.887314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca3c3-05ff-4ae0-921e-c8de67e8a110 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:24.887600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca3c3-05ff-4ae0-921e-c8de67e8a110 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:24.888503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ca3c3-05ff-4ae0-921e-c8de67e8a110 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:24.889397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ca3c3-05ff-4ae0-921e-c8de67e8a110 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:24.890886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ca3c3-05ff-4ae0-921e-c8de67e8a110 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:24.984909 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 27/57] 10.222.0.42 () {60 vars in 1140 bytes} [Fri May 27 13:38:24 2022] POST /identity/v3/projects => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:38:27.195481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058f94-71ba-4e02-9dc3-9d1635c99e25 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:27.196060 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058f94-71ba-4e02-9dc3-9d1635c99e25 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:27.196060 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6058f94-71ba-4e02-9dc3-9d1635c99e25 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:27.197396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 31/58] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:27.203347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca62a93-c0a6-4ac7-9690-69c1549b9bbc None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:27.203773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca62a93-c0a6-4ac7-9690-69c1549b9bbc None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:27.203919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca62a93-c0a6-4ac7-9690-69c1549b9bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:27.221208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3ca62a93-c0a6-4ac7-9690-69c1549b9bbc None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:27.222400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3ca62a93-c0a6-4ac7-9690-69c1549b9bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:27.287614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 28/59] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:27.312959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6058f94-71ba-4e02-9dc3-9d1635c99e25 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:27.328956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:27.413465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6058f94-71ba-4e02-9dc3-9d1635c99e25 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:27.446793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156919e6-02fa-43a5-b914-364a6e439690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:27.447535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156919e6-02fa-43a5-b914-364a6e439690 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:27.447810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156919e6-02fa-43a5-b914-364a6e439690 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:27.448083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156919e6-02fa-43a5-b914-364a6e439690 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:27.449244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156919e6-02fa-43a5-b914-364a6e439690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:27.451408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156919e6-02fa-43a5-b914-364a6e439690 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:27.452998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 32/60] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:27.458447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca62a93-c0a6-4ac7-9690-69c1549b9bbc None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:27.499292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:27.554576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca62a93-c0a6-4ac7-9690-69c1549b9bbc None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:27.587162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818acc4a-6747-4644-b349-f9df8d1082ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:27.588070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818acc4a-6747-4644-b349-f9df8d1082ae None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:27.588545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818acc4a-6747-4644-b349-f9df8d1082ae None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:27.589390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818acc4a-6747-4644-b349-f9df8d1082ae None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:27.590129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818acc4a-6747-4644-b349-f9df8d1082ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:27.592527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818acc4a-6747-4644-b349-f9df8d1082ae None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:27.745226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 29/61] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:38:27 2022] POST /identity/v3/users => generated 275 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:38:30.927794 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca72f99-8728-4601-88cb-9bb34b9a9540 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:30.928296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca72f99-8728-4601-88cb-9bb34b9a9540 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:30.928296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca72f99-8728-4601-88cb-9bb34b9a9540 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:30.929653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 33/62] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:30.935495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe03b4f-0d7a-4ab6-bd1c-e3feed73af4a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:30.935920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe03b4f-0d7a-4ab6-bd1c-e3feed73af4a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:30.936133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe03b4f-0d7a-4ab6-bd1c-e3feed73af4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:30.964272 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-cbe03b4f-0d7a-4ab6-bd1c-e3feed73af4a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:30.965531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cbe03b4f-0d7a-4ab6-bd1c-e3feed73af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:31.061315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 30/63] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:31.100827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca72f99-8728-4601-88cb-9bb34b9a9540 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:31.170316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013942f-7120-4f3d-a99c-e5c1fa0aedc3 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.171046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013942f-7120-4f3d-a99c-e5c1fa0aedc3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.171561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013942f-7120-4f3d-a99c-e5c1fa0aedc3 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.173528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 31/64] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:31.189574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b261818-2890-4a81-bdfd-980e129b04a7 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.189574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b261818-2890-4a81-bdfd-980e129b04a7 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.189574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b261818-2890-4a81-bdfd-980e129b04a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.202323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8b261818-2890-4a81-bdfd-980e129b04a7 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:31.203540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8b261818-2890-4a81-bdfd-980e129b04a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:31.237829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:31.253320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:31.281282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca72f99-8728-4601-88cb-9bb34b9a9540 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:31.332570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54025068-19a2-4cc3-9f70-4863530e153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:31.335296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54025068-19a2-4cc3-9f70-4863530e153d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.335591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54025068-19a2-4cc3-9f70-4863530e153d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.335870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54025068-19a2-4cc3-9f70-4863530e153d None admin] PATH_INFO: `/v3/roles/member` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.347232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 32/65] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:31.354191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54025068-19a2-4cc3-9f70-4863530e153d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-54025068-19a2-4cc3-9f70-4863530e153d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:31.363626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:31.364784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:31.365733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:31.368226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 34/66] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:31.373761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b261818-2890-4a81-bdfd-980e129b04a7 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:31.384118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54025068-19a2-4cc3-9f70-4863530e153d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:31.509632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54025068-19a2-4cc3-9f70-4863530e153d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:31.547522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae140-b2fe-465f-a927-6c2c0068bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:31.548702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae140-b2fe-465f-a927-6c2c0068bc63 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.549199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae140-b2fe-465f-a927-6c2c0068bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.549691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae140-b2fe-465f-a927-6c2c0068bc63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.560943 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ae140-b2fe-465f-a927-6c2c0068bc63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-918ae140-b2fe-465f-a927-6c2c0068bc63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:31.569386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:31.570309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:31.571553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:31.574151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 35/67] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:38:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:31.583283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae140-b2fe-465f-a927-6c2c0068bc63 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:31.587310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:31.601375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b261818-2890-4a81-bdfd-980e129b04a7 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:31.662249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c818-0617-485b-ba1e-4b9836ec97d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:31.662933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c818-0617-485b-ba1e-4b9836ec97d9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.663252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c818-0617-485b-ba1e-4b9836ec97d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.663533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c818-0617-485b-ba1e-4b9836ec97d9 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.664322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c818-0617-485b-ba1e-4b9836ec97d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:31.664636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c818-0617-485b-ba1e-4b9836ec97d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:31.666065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c818-0617-485b-ba1e-4b9836ec97d9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:31.681806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 33/68] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:31.685708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6418f1-116d-4ea5-a267-d9160e57a2e7 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.686546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6418f1-116d-4ea5-a267-d9160e57a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.687033 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6418f1-116d-4ea5-a267-d9160e57a2e7 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.688528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 34/69] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:31.689517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069ff5-0f44-47d9-bc47-9e504048a25f None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.689803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069ff5-0f44-47d9-bc47-9e504048a25f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.690133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9069ff5-0f44-47d9-bc47-9e504048a25f None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.691698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 35/70] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:31.692419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9069ff5-0f44-47d9-bc47-9e504048a25f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:31.707174 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae140-b2fe-465f-a927-6c2c0068bc63 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:31.713859 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:31.742673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d873ff0-9005-4d9e-aa34-f8cec2e339ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:31.743382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d873ff0-9005-4d9e-aa34-f8cec2e339ae None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.743668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d873ff0-9005-4d9e-aa34-f8cec2e339ae None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.743949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d873ff0-9005-4d9e-aa34-f8cec2e339ae None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.744693 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d873ff0-9005-4d9e-aa34-f8cec2e339ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:31.745004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d873ff0-9005-4d9e-aa34-f8cec2e339ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:31.746399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d873ff0-9005-4d9e-aa34-f8cec2e339ae None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:31.756068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:31.757279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3df60-7465-46f1-a6e1-dc0ac6ad5d00 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.757566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3df60-7465-46f1-a6e1-dc0ac6ad5d00 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.757841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3df60-7465-46f1-a6e1-dc0ac6ad5d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.774405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-00f3df60-7465-46f1-a6e1-dc0ac6ad5d00 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:31.775548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-00f3df60-7465-46f1-a6e1-dc0ac6ad5d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:31.808548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9069ff5-0f44-47d9-bc47-9e504048a25f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:31.833472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:31.842074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 37/72] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:31.848564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dde30-903f-4058-86af-a2e16595c2ba None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.848564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dde30-903f-4058-86af-a2e16595c2ba None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.848564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094dde30-903f-4058-86af-a2e16595c2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.848934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba0662-8ead-4afc-ab10-a87186141d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:31.849742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba0662-8ead-4afc-ab10-a87186141d5e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.850028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba0662-8ead-4afc-ab10-a87186141d5e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.850308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba0662-8ead-4afc-ab10-a87186141d5e None admin] PATH_INFO: `/v3/users/b34cdcd2c3194a99b2b1075d635e61f4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.862615 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-094dde30-903f-4058-86af-a2e16595c2ba None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:31.863813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-094dde30-903f-4058-86af-a2e16595c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:31.876674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba0662-8ead-4afc-ab10-a87186141d5e None admin] RBAC: Authorizing `identity:get_user(user_id=b34cdcd2c3194a99b2b1075d635e61f4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:31.878118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba0662-8ead-4afc-ab10-a87186141d5e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:31.879860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:31 2022] GET /identity/v3/users/b34cdcd2c3194a99b2b1075d635e61f4 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:31.880615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba0662-8ead-4afc-ab10-a87186141d5e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:31.931203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 38/74] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:31.932712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70161c0d-c23f-4ee3-bd76-2db1f9bcffd0 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:31.933013 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70161c0d-c23f-4ee3-bd76-2db1f9bcffd0 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:31.933297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70161c0d-c23f-4ee3-bd76-2db1f9bcffd0 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:31.939336 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 39/75] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:31.940102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70161c0d-c23f-4ee3-bd76-2db1f9bcffd0 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:31.959928 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:31.981645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba0662-8ead-4afc-ab10-a87186141d5e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.016953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dc7c8-6828-4f6f-986c-8b7ba3feda45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.017826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dc7c8-6828-4f6f-986c-8b7ba3feda45 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.018116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dc7c8-6828-4f6f-986c-8b7ba3feda45 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.018396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7dc7c8-6828-4f6f-986c-8b7ba3feda45 None admin] PATH_INFO: `/v3/users/4343916bc48d4b1596f21b7dfce5ddf4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.019617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dc7c8-6828-4f6f-986c-8b7ba3feda45 None admin] RBAC: Authorizing `identity:get_user(user_id=4343916bc48d4b1596f21b7dfce5ddf4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:32.021083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7dc7c8-6828-4f6f-986c-8b7ba3feda45 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:32.022729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 37/76] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:31 2022] GET /identity/v3/users/4343916bc48d4b1596f21b7dfce5ddf4 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:32.023508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dc7c8-6828-4f6f-986c-8b7ba3feda45 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.050523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70161c0d-c23f-4ee3-bd76-2db1f9bcffd0 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.073469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:32.084406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ca9fb-8895-4fb8-8c8b-cdbf40c46432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.088623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca9fb-8895-4fb8-8c8b-cdbf40c46432 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.088623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca9fb-8895-4fb8-8c8b-cdbf40c46432 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.088623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca9fb-8895-4fb8-8c8b-cdbf40c46432 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.095909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ca9fb-8895-4fb8-8c8b-cdbf40c46432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-315ca9fb-8895-4fb8-8c8b-cdbf40c46432 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:32.103935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:32.104855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:32.105641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 40/77] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:38:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:32.106274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9893e6e-7ac5-4b53-bf9a-529968b131dc None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.107037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9893e6e-7ac5-4b53-bf9a-529968b131dc None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.107037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9893e6e-7ac5-4b53-bf9a-529968b131dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.123254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-e9893e6e-7ac5-4b53-bf9a-529968b131dc None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:32.124436 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e9893e6e-7ac5-4b53-bf9a-529968b131dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:32.125917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7dc7c8-6828-4f6f-986c-8b7ba3feda45 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.160561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa78d69-c382-4b20-95ba-338d9bcfa3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.161212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78d69-c382-4b20-95ba-338d9bcfa3e7 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.161495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78d69-c382-4b20-95ba-338d9bcfa3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.161771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa78d69-c382-4b20-95ba-338d9bcfa3e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.176810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:32.193042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 41/78] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:32.193881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9893e6e-7ac5-4b53-bf9a-529968b131dc None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.230828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa78d69-c382-4b20-95ba-338d9bcfa3e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:32.232558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa78d69-c382-4b20-95ba-338d9bcfa3e7 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:32.292431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9893e6e-7ac5-4b53-bf9a-529968b131dc None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.306773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:32.327401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c78918-0c80-45bc-b451-5ae9fc9567a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.328198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c78918-0c80-45bc-b451-5ae9fc9567a7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.328480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c78918-0c80-45bc-b451-5ae9fc9567a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.328756 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c78918-0c80-45bc-b451-5ae9fc9567a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.331100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 38/79] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:32.332021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa78d69-c382-4b20-95ba-338d9bcfa3e7 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.340432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c78918-0c80-45bc-b451-5ae9fc9567a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-77c78918-0c80-45bc-b451-5ae9fc9567a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:32.348239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:32.349086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:32.349836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 42/80] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:32.350458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c78918-0c80-45bc-b451-5ae9fc9567a7 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.382675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:32.437748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa78d69-c382-4b20-95ba-338d9bcfa3e7 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.452220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c78918-0c80-45bc-b451-5ae9fc9567a7 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.471638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e197a-2b44-4407-926d-9d0acee7f37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.472303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e197a-2b44-4407-926d-9d0acee7f37b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.472589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e197a-2b44-4407-926d-9d0acee7f37b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.472870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e197a-2b44-4407-926d-9d0acee7f37b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.497262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf14df-f3d2-4b86-94fe-f4b783521b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.497922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf14df-f3d2-4b86-94fe-f4b783521b33 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.498208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf14df-f3d2-4b86-94fe-f4b783521b33 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.498488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf14df-f3d2-4b86-94fe-f4b783521b33 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.499267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf14df-f3d2-4b86-94fe-f4b783521b33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:32.499577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf14df-f3d2-4b86-94fe-f4b783521b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:32.501078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf14df-f3d2-4b86-94fe-f4b783521b33 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:32.508898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 43/81] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:38:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:32.509676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf14df-f3d2-4b86-94fe-f4b783521b33 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.542438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e197a-2b44-4407-926d-9d0acee7f37b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:32.543974 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e197a-2b44-4407-926d-9d0acee7f37b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:32.544362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:32.586803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:32.608396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf14df-f3d2-4b86-94fe-f4b783521b33 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.640464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 39/82] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:32.641369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e197a-2b44-4407-926d-9d0acee7f37b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.645894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb32e4-de4b-431b-af8e-9752d0ad4b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.646717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb32e4-de4b-431b-af8e-9752d0ad4b3d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.647037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb32e4-de4b-431b-af8e-9752d0ad4b3d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.647326 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb32e4-de4b-431b-af8e-9752d0ad4b3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.649490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb32e4-de4b-431b-af8e-9752d0ad4b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:32.651093 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb32e4-de4b-431b-af8e-9752d0ad4b3d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:32.652851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 44/83] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:32.654416 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb32e4-de4b-431b-af8e-9752d0ad4b3d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.739867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e197a-2b44-4407-926d-9d0acee7f37b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.756680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb32e4-de4b-431b-af8e-9752d0ad4b3d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.759070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:32.779666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4048f-27c1-4df6-b94f-d1d21390d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.780675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4048f-27c1-4df6-b94f-d1d21390d3d5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.781121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4048f-27c1-4df6-b94f-d1d21390d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.781498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4048f-27c1-4df6-b94f-d1d21390d3d5 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.783162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4048f-27c1-4df6-b94f-d1d21390d3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:32.784964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4048f-27c1-4df6-b94f-d1d21390d3d5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:32.787563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 40/84] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:32 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:32.788125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4048f-27c1-4df6-b94f-d1d21390d3d5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.797696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d038-79d6-4854-b376-55fc04db859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.798375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d038-79d6-4854-b376-55fc04db859c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.798664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d038-79d6-4854-b376-55fc04db859c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.798944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465d038-79d6-4854-b376-55fc04db859c None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.799731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465d038-79d6-4854-b376-55fc04db859c None admin] RBAC: Adding query filter params (name=member) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:32.800044 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465d038-79d6-4854-b376-55fc04db859c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:32.801461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465d038-79d6-4854-b376-55fc04db859c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:32.803296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:32.809853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 45/85] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:32.813651 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d038-79d6-4854-b376-55fc04db859c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.888434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4048f-27c1-4df6-b94f-d1d21390d3d5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.913400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465d038-79d6-4854-b376-55fc04db859c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:32.923083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd929-b972-42b7-9642-2a4cfeb5a785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.923971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd929-b972-42b7-9642-2a4cfeb5a785 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.924293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd929-b972-42b7-9642-2a4cfeb5a785 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.924604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd929-b972-42b7-9642-2a4cfeb5a785 None admin] PATH_INFO: `/v3/users/b34cdcd2c3194a99b2b1075d635e61f4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.925860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fd929-b972-42b7-9642-2a4cfeb5a785 None admin] RBAC: Authorizing `identity:get_user(user_id=b34cdcd2c3194a99b2b1075d635e61f4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:32.927347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fd929-b972-42b7-9642-2a4cfeb5a785 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:32.928966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 41/86] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:32 2022] GET /identity/v3/users/b34cdcd2c3194a99b2b1075d635e61f4 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:32.929724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd929-b972-42b7-9642-2a4cfeb5a785 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.948760 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8d33-df5d-4dff-bccd-abca06e8183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:32.949619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8d33-df5d-4dff-bccd-abca06e8183d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:32.949904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8d33-df5d-4dff-bccd-abca06e8183d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:32.950181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff8d33-df5d-4dff-bccd-abca06e8183d None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:32.951541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff8d33-df5d-4dff-bccd-abca06e8183d None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:32.953011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff8d33-df5d-4dff-bccd-abca06e8183d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:32.954699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 46/87] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:32 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:32.955484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8d33-df5d-4dff-bccd-abca06e8183d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:32.990832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:33.010217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:33.029018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd929-b972-42b7-9642-2a4cfeb5a785 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:33.057470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff8d33-df5d-4dff-bccd-abca06e8183d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:33.063767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52562ce-9b2a-4b0d-9fd0-2f605d324631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:33.065410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52562ce-9b2a-4b0d-9fd0-2f605d324631 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:33.065692 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52562ce-9b2a-4b0d-9fd0-2f605d324631 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:33.065965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52562ce-9b2a-4b0d-9fd0-2f605d324631 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:33.066668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52562ce-9b2a-4b0d-9fd0-2f605d324631 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:33.068145 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52562ce-9b2a-4b0d-9fd0-2f605d324631 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:33.091965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19c8fa-435c-46c2-8f31-ffc9b1e5de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:33.092624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19c8fa-435c-46c2-8f31-ffc9b1e5de0c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:33.092915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19c8fa-435c-46c2-8f31-ffc9b1e5de0c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:33.093196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19c8fa-435c-46c2-8f31-ffc9b1e5de0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:33.094035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19c8fa-435c-46c2-8f31-ffc9b1e5de0c None admin] RBAC: Adding query filter params (role.id=1067c35f1111496c983a6a7dec2a5ad9, scope.project.id=b3755fb9019c4a62a3376df0865a1020, user.id=b34cdcd2c3194a99b2b1075d635e61f4) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:33.094350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19c8fa-435c-46c2-8f31-ffc9b1e5de0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:33.095850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19c8fa-435c-46c2-8f31-ffc9b1e5de0c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:33.101397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 47/88] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:32 2022] GET /identity/v3/role_assignments?user.id=b34cdcd2c3194a99b2b1075d635e61f4&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:33.102258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19c8fa-435c-46c2-8f31-ffc9b1e5de0c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:33.207988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:33.211772 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19c8fa-435c-46c2-8f31-ffc9b1e5de0c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:33.247204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb41c8-99ec-4dfc-b882-dd1423f48413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:33.248102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb41c8-99ec-4dfc-b882-dd1423f48413 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:33.248385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb41c8-99ec-4dfc-b882-dd1423f48413 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:33.248667 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb41c8-99ec-4dfc-b882-dd1423f48413 None admin] PATH_INFO: `/v3/users/b34cdcd2c3194a99b2b1075d635e61f4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:33.249891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb41c8-99ec-4dfc-b882-dd1423f48413 None admin] RBAC: Authorizing `identity:get_user(user_id=b34cdcd2c3194a99b2b1075d635e61f4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:33.251412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb41c8-99ec-4dfc-b882-dd1423f48413 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:33.253115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 48/89] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:33 2022] GET /identity/v3/users/b34cdcd2c3194a99b2b1075d635e61f4 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:33.253911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb41c8-99ec-4dfc-b882-dd1423f48413 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:33.273408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 42/90] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:38:32 2022] POST /identity/v3/users => generated 289 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:38:33.273408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52562ce-9b2a-4b0d-9fd0-2f605d324631 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:33.389189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb41c8-99ec-4dfc-b882-dd1423f48413 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:33.431575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ab833-51a4-4f8d-b98d-1db5c75c2f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:33.432393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ab833-51a4-4f8d-b98d-1db5c75c2f72 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:33.432758 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ab833-51a4-4f8d-b98d-1db5c75c2f72 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:33.433112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ab833-51a4-4f8d-b98d-1db5c75c2f72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:33.441621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52562ce-9b2a-4b0d-9fd0-2f605d324631 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:33.473351 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:33.498510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe499789-d65f-4a59-8fc6-2424e52837de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:33.499204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe499789-d65f-4a59-8fc6-2424e52837de None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:33.499496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe499789-d65f-4a59-8fc6-2424e52837de None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:33.499773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe499789-d65f-4a59-8fc6-2424e52837de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:33.500614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe499789-d65f-4a59-8fc6-2424e52837de None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=b3755fb9019c4a62a3376df0865a1020, user.id=4343916bc48d4b1596f21b7dfce5ddf4) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:33.500929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe499789-d65f-4a59-8fc6-2424e52837de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:33.502372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe499789-d65f-4a59-8fc6-2424e52837de None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:33.507115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:33.510456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 43/91] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:33 2022] GET /identity/v3/role_assignments?user.id=4343916bc48d4b1596f21b7dfce5ddf4&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=3951cc86a51d416fafc5676d456e79ce => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:33.511306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe499789-d65f-4a59-8fc6-2424e52837de None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:33.519386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ab833-51a4-4f8d-b98d-1db5c75c2f72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:33.520929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ab833-51a4-4f8d-b98d-1db5c75c2f72 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:33.682014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe499789-d65f-4a59-8fc6-2424e52837de None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:33.684278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 49/92] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:33.694625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ab833-51a4-4f8d-b98d-1db5c75c2f72 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:33.724083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eefe4a-e019-43dd-9146-e6212761b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:33.724719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eefe4a-e019-43dd-9146-e6212761b796 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:33.725008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eefe4a-e019-43dd-9146-e6212761b796 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:33.725287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eefe4a-e019-43dd-9146-e6212761b796 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:33.789310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:33.804093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eefe4a-e019-43dd-9146-e6212761b796 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:33.805578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eefe4a-e019-43dd-9146-e6212761b796 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:33.826122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:33.833312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ab833-51a4-4f8d-b98d-1db5c75c2f72 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:33.879599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc146-91a5-4248-b499-29aff229821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:33.881016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc146-91a5-4248-b499-29aff229821d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:33.881305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc146-91a5-4248-b499-29aff229821d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:33.881586 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdc146-91a5-4248-b499-29aff229821d None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:33.882799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdc146-91a5-4248-b499-29aff229821d None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:33.884480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdc146-91a5-4248-b499-29aff229821d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:33.887013 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 50/93] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:33 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:33.893859 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc146-91a5-4248-b499-29aff229821d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:33.944236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 44/94] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:33.949861 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eefe4a-e019-43dd-9146-e6212761b796 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:34.003342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdc146-91a5-4248-b499-29aff229821d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:34.038993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c0b13-54c4-461b-9f7c-b634b5f50907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:34.038993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c0b13-54c4-461b-9f7c-b634b5f50907 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:34.039281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c0b13-54c4-461b-9f7c-b634b5f50907 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:34.039512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c0b13-54c4-461b-9f7c-b634b5f50907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:34.040360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c0b13-54c4-461b-9f7c-b634b5f50907 None admin] RBAC: Adding query filter params (role.id=a97f5aba7e1b4044b2c749cba5d5708f, scope.project.id=b3755fb9019c4a62a3376df0865a1020, user.id=b34cdcd2c3194a99b2b1075d635e61f4) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:34.040672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c0b13-54c4-461b-9f7c-b634b5f50907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:34.042125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c0b13-54c4-461b-9f7c-b634b5f50907 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:34.044737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:34.049588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 51/95] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:33 2022] GET /identity/v3/role_assignments?user.id=b34cdcd2c3194a99b2b1075d635e61f4&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=a97f5aba7e1b4044b2c749cba5d5708f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:34.115575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eefe4a-e019-43dd-9146-e6212761b796 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:34.119823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:34.174917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d72575-8ef2-4f9f-a252-712f854d9dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:34.176329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72575-8ef2-4f9f-a252-712f854d9dbb None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:34.176829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72575-8ef2-4f9f-a252-712f854d9dbb None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:34.177304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72575-8ef2-4f9f-a252-712f854d9dbb None admin] PATH_INFO: `/v3/projects/54195529d2f944e9b2520c01b629b8f6` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:34.183928 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d72575-8ef2-4f9f-a252-712f854d9dbb None admin] RBAC: Authorizing `identity:get_project(project_id=54195529d2f944e9b2520c01b629b8f6)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:34.186441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d72575-8ef2-4f9f-a252-712f854d9dbb None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:34.188686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 45/96] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:33 2022] GET /identity/v3/projects/54195529d2f944e9b2520c01b629b8f6 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:34.194633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c0b13-54c4-461b-9f7c-b634b5f50907 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:34.345070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c0b13-54c4-461b-9f7c-b634b5f50907 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:34.380326 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff9a1f-7431-453f-b435-d6ef3f1a35c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:34.381000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff9a1f-7431-453f-b435-d6ef3f1a35c7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:34.381295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff9a1f-7431-453f-b435-d6ef3f1a35c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:34.381577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff9a1f-7431-453f-b435-d6ef3f1a35c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:34.382417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff9a1f-7431-453f-b435-d6ef3f1a35c7 None admin] RBAC: Adding query filter params (role.id=1067c35f1111496c983a6a7dec2a5ad9, scope.project.id=54195529d2f944e9b2520c01b629b8f6, user.id=b34cdcd2c3194a99b2b1075d635e61f4) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:34.382732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff9a1f-7431-453f-b435-d6ef3f1a35c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:34.384208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff9a1f-7431-453f-b435-d6ef3f1a35c7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:34.391178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 52/97] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:34 2022] GET /identity/v3/role_assignments?user.id=b34cdcd2c3194a99b2b1075d635e61f4&scope.project.id=54195529d2f944e9b2520c01b629b8f6&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:36.181551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc171a-a5b2-4600-8a19-7c962c4ef93b None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:36.182551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc171a-a5b2-4600-8a19-7c962c4ef93b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:36.183099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc171a-a5b2-4600-8a19-7c962c4ef93b None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:36.184723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 46/98] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:36.190699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc182-8753-431b-a805-e8dbb472a3c5 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:36.191606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc182-8753-431b-a805-e8dbb472a3c5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:36.192119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc182-8753-431b-a805-e8dbb472a3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:36.213621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-25acc182-8753-431b-a805-e8dbb472a3c5 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:36.215169 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-25acc182-8753-431b-a805-e8dbb472a3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:36.319384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:36.333026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 53/99] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:36.366414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc171a-a5b2-4600-8a19-7c962c4ef93b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:36.517564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc171a-a5b2-4600-8a19-7c962c4ef93b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:36.571972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1cd7e7-90df-4941-b6e2-54c53fcfe42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:36.572778 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd7e7-90df-4941-b6e2-54c53fcfe42d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:36.573067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd7e7-90df-4941-b6e2-54c53fcfe42d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:36.573344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1cd7e7-90df-4941-b6e2-54c53fcfe42d None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:36.592245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1cd7e7-90df-4941-b6e2-54c53fcfe42d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-fe1cd7e7-90df-4941-b6e2-54c53fcfe42d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:36.600132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:36.600948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:36.601770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 47/100] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:36.609091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc182-8753-431b-a805-e8dbb472a3c5 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:36.670827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b2fa1-bb78-4f2c-9c64-9c1cb1d78d02 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:36.671176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b2fa1-bb78-4f2c-9c64-9c1cb1d78d02 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:36.671447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b2fa1-bb78-4f2c-9c64-9c1cb1d78d02 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:36.673273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 48/101] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:38:36.684496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07add-eb69-4bee-8dad-220a47d67367 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:36.685663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07add-eb69-4bee-8dad-220a47d67367 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:36.686106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07add-eb69-4bee-8dad-220a47d67367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:36.732698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-e1b07add-eb69-4bee-8dad-220a47d67367 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:36.733910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-e1b07add-eb69-4bee-8dad-220a47d67367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:36.784115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:36.788259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc182-8753-431b-a805-e8dbb472a3c5 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:36.827884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec4959-5dbc-45c8-b841-93a4179bc1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:36.828576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec4959-5dbc-45c8-b841-93a4179bc1b5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:36.828868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec4959-5dbc-45c8-b841-93a4179bc1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:36.829154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec4959-5dbc-45c8-b841-93a4179bc1b5 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:36.829924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec4959-5dbc-45c8-b841-93a4179bc1b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:36.830260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec4959-5dbc-45c8-b841-93a4179bc1b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:36.831675 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec4959-5dbc-45c8-b841-93a4179bc1b5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:36.845311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 54/102] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:36.845311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020a864-3e12-470c-9617-c90a05d38c7c None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:36.845311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020a864-3e12-470c-9617-c90a05d38c7c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:36.845311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020a864-3e12-470c-9617-c90a05d38c7c None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:36.845311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 55/103] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:36.846200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08d392-8bfb-450f-b69f-344da80dbd1f None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:36.846491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08d392-8bfb-450f-b69f-344da80dbd1f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:36.851748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08d392-8bfb-450f-b69f-344da80dbd1f None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:36.852278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 56/104] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:36.853087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 49/105] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:36.854631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c78b-55b0-4dd8-a922-990cce72e843 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:36.854631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c78b-55b0-4dd8-a922-990cce72e843 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:36.854631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94c78b-55b0-4dd8-a922-990cce72e843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:36.855986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b07add-eb69-4bee-8dad-220a47d67367 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:36.892855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ef94c78b-55b0-4dd8-a922-990cce72e843 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:36.894061 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ef94c78b-55b0-4dd8-a922-990cce72e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:36.947839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:36.967169 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 57/106] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:36.968542 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558cd39-1f1f-46f2-a37f-87365ea14225 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:36.968865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558cd39-1f1f-46f2-a37f-87365ea14225 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:36.969128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558cd39-1f1f-46f2-a37f-87365ea14225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:36.987899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b07add-eb69-4bee-8dad-220a47d67367 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:37.001907 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f558cd39-1f1f-46f2-a37f-87365ea14225 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:37.004543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f558cd39-1f1f-46f2-a37f-87365ea14225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:37.040089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cb744-1271-49cc-9af7-ca45f096cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:37.041619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cb744-1271-49cc-9af7-ca45f096cfbe None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:37.042128 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cb744-1271-49cc-9af7-ca45f096cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:37.042618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cb744-1271-49cc-9af7-ca45f096cfbe None admin] PATH_INFO: `/v3/users/b34cdcd2c3194a99b2b1075d635e61f4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:37.045301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cb744-1271-49cc-9af7-ca45f096cfbe None admin] RBAC: Authorizing `identity:get_user(user_id=b34cdcd2c3194a99b2b1075d635e61f4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:37.047412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cb744-1271-49cc-9af7-ca45f096cfbe None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:37.049280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 50/107] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:36 2022] GET /identity/v3/users/b34cdcd2c3194a99b2b1075d635e61f4 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:37.050926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cb744-1271-49cc-9af7-ca45f096cfbe None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:37.081038 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 58/108] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:37.081905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558cd39-1f1f-46f2-a37f-87365ea14225 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:37.088191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:37.170630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cb744-1271-49cc-9af7-ca45f096cfbe None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:37.207623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48532b-4db6-4d67-a271-c248adde5adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:37.208428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48532b-4db6-4d67-a271-c248adde5adb None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:37.208718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48532b-4db6-4d67-a271-c248adde5adb None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:37.209000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48532b-4db6-4d67-a271-c248adde5adb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:37.222477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48532b-4db6-4d67-a271-c248adde5adb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:37.225173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558cd39-1f1f-46f2-a37f-87365ea14225 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-8a48532b-4db6-4d67-a271-c248adde5adb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:37.232260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:37.233231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:37.234178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 51/109] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:38:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:37.234821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48532b-4db6-4d67-a271-c248adde5adb None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:37.254583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:37.285673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc416b-3ab5-46d8-874f-96d0389c9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:37.286568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc416b-3ab5-46d8-874f-96d0389c9a7c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:37.286909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc416b-3ab5-46d8-874f-96d0389c9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:37.287226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc416b-3ab5-46d8-874f-96d0389c9a7c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:37.311305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc416b-3ab5-46d8-874f-96d0389c9a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-47bc416b-3ab5-46d8-874f-96d0389c9a7c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:37.311983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:37.313008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:38:37.313966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:37.320111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 59/110] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:37.320111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc416b-3ab5-46d8-874f-96d0389c9a7c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:37.369994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:37.394767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48532b-4db6-4d67-a271-c248adde5adb None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:37.431327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc416b-3ab5-46d8-874f-96d0389c9a7c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:37.444889 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689b1c-1ad3-4676-b918-9bf425c584e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:37.446259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689b1c-1ad3-4676-b918-9bf425c584e4 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:37.446697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689b1c-1ad3-4676-b918-9bf425c584e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:37.447155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa689b1c-1ad3-4676-b918-9bf425c584e4 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:37.449224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa689b1c-1ad3-4676-b918-9bf425c584e4 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:37.451902 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa689b1c-1ad3-4676-b918-9bf425c584e4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:37.454294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 52/111] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:37 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:37.455340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689b1c-1ad3-4676-b918-9bf425c584e4 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:37.472932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d56a95-7f34-4213-aff7-2a5efebff32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:37.473905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d56a95-7f34-4213-aff7-2a5efebff32d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:37.474253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d56a95-7f34-4213-aff7-2a5efebff32d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:37.474627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d56a95-7f34-4213-aff7-2a5efebff32d None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:37.476081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d56a95-7f34-4213-aff7-2a5efebff32d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:37.477747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d56a95-7f34-4213-aff7-2a5efebff32d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:37.479711 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 60/112] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:37.480642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d56a95-7f34-4213-aff7-2a5efebff32d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:37.530219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:37.583220 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa689b1c-1ad3-4676-b918-9bf425c584e4 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:37.600731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d56a95-7f34-4213-aff7-2a5efebff32d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:37.620412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d525f-5fd5-404b-a973-ad9a25b38088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:37.621657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d525f-5fd5-404b-a973-ad9a25b38088 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:37.622153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d525f-5fd5-404b-a973-ad9a25b38088 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:37.622690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d525f-5fd5-404b-a973-ad9a25b38088 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:37.623482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d525f-5fd5-404b-a973-ad9a25b38088 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:37.624040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d525f-5fd5-404b-a973-ad9a25b38088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:37.626139 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d525f-5fd5-404b-a973-ad9a25b38088 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:37.635387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff948e3c-4edb-444c-9d67-394e63b800be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:37.636070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948e3c-4edb-444c-9d67-394e63b800be None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:37.636365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948e3c-4edb-444c-9d67-394e63b800be None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:37.636611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 53/113] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:37.637435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d525f-5fd5-404b-a973-ad9a25b38088 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:37.642273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948e3c-4edb-444c-9d67-394e63b800be None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:37.643129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff948e3c-4edb-444c-9d67-394e63b800be None admin] RBAC: Adding query filter params (name=reader) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:37.643462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff948e3c-4edb-444c-9d67-394e63b800be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:37.644900 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff948e3c-4edb-444c-9d67-394e63b800be None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:37.659001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 61/114] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:37.659001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff948e3c-4edb-444c-9d67-394e63b800be None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:37.665991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:37.759093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d525f-5fd5-404b-a973-ad9a25b38088 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:37.769756 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff948e3c-4edb-444c-9d67-394e63b800be None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:37.772216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:37.796547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea1e8-2a5f-4934-add2-7b915c6a1514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:37.797710 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea1e8-2a5f-4934-add2-7b915c6a1514 None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:37.798004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea1e8-2a5f-4934-add2-7b915c6a1514 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:37.798283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea1e8-2a5f-4934-add2-7b915c6a1514 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020/users/b34cdcd2c3194a99b2b1075d635e61f4/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:37.800314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea1e8-2a5f-4934-add2-7b915c6a1514 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3755fb9019c4a62a3376df0865a1020, user_id=b34cdcd2c3194a99b2b1075d635e61f4, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:37.801784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea1e8-2a5f-4934-add2-7b915c6a1514 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:37.805647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd13507-4ece-4a92-aab8-53d90d4bb6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:37.806313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd13507-4ece-4a92-aab8-53d90d4bb6b3 None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:37.806606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd13507-4ece-4a92-aab8-53d90d4bb6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:37.806890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd13507-4ece-4a92-aab8-53d90d4bb6b3 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:37.807646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd13507-4ece-4a92-aab8-53d90d4bb6b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:37.809089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd13507-4ece-4a92-aab8-53d90d4bb6b3 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:37.935221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 54/115] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:38:37 2022] PUT /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020/users/b34cdcd2c3194a99b2b1075d635e61f4/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:38:37.936457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e82d-77e3-48a0-a72e-2b07eb45fcd5 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:37.936750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e82d-77e3-48a0-a72e-2b07eb45fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:37.937032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430e82d-77e3-48a0-a72e-2b07eb45fcd5 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:37.938320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 55/116] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:37.939138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430e82d-77e3-48a0-a72e-2b07eb45fcd5 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:38.023950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:38.027669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 62/117] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:38:37 2022] POST /identity/v3/projects => generated 302 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:38:38.028414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd13507-4ece-4a92-aab8-53d90d4bb6b3 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:38.062496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430e82d-77e3-48a0-a72e-2b07eb45fcd5 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:38.113404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db3792-dbeb-43e5-a924-c83edb7ec6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:38.114903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3792-dbeb-43e5-a924-c83edb7ec6ae None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.115917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3792-dbeb-43e5-a924-c83edb7ec6ae None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.116440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db3792-dbeb-43e5-a924-c83edb7ec6ae None admin] PATH_INFO: `/v3/users/4343916bc48d4b1596f21b7dfce5ddf4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.118482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db3792-dbeb-43e5-a924-c83edb7ec6ae None admin] RBAC: Authorizing `identity:get_user(user_id=4343916bc48d4b1596f21b7dfce5ddf4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:38.121032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db3792-dbeb-43e5-a924-c83edb7ec6ae None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:38.125022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 56/118] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:37 2022] GET /identity/v3/users/4343916bc48d4b1596f21b7dfce5ddf4 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:38.126802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0271e-cf46-4dbd-9966-d5b9d8767b34 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.127261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0271e-cf46-4dbd-9966-d5b9d8767b34 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.127676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0271e-cf46-4dbd-9966-d5b9d8767b34 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.129997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 57/119] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:38.131943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca43ad8-4b06-496d-8c03-ff207296f89b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.132376 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca43ad8-4b06-496d-8c03-ff207296f89b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.132804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca43ad8-4b06-496d-8c03-ff207296f89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.155150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7ca43ad8-4b06-496d-8c03-ff207296f89b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:38.156621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7ca43ad8-4b06-496d-8c03-ff207296f89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:38.192345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd13507-4ece-4a92-aab8-53d90d4bb6b3 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:38.237241 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b877e-6558-4758-b449-dcce737dae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:38.238837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b877e-6558-4758-b449-dcce737dae57 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.239151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b877e-6558-4758-b449-dcce737dae57 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.239442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b877e-6558-4758-b449-dcce737dae57 None admin] PATH_INFO: `/v3/users/5b5c2d1ca27e412f8ab327a40ff52efa` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.255331 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 58/120] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:38.256820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca43ad8-4b06-496d-8c03-ff207296f89b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:38.263397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b877e-6558-4758-b449-dcce737dae57 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5c2d1ca27e412f8ab327a40ff52efa)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:38.263397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b877e-6558-4758-b449-dcce737dae57 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:38.264248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 63/121] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:38 2022] GET /identity/v3/users/5b5c2d1ca27e412f8ab327a40ff52efa => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:38.265689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05730f-dfaf-4bc4-92ca-bb7bc158f4ca None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.265936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05730f-dfaf-4bc4-92ca-bb7bc158f4ca None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.266222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe05730f-dfaf-4bc4-92ca-bb7bc158f4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.285187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fe05730f-dfaf-4bc4-92ca-bb7bc158f4ca None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:38.286490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fe05730f-dfaf-4bc4-92ca-bb7bc158f4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:38.300669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:38.362869 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:38.371196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 64/122] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:38.373134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05730f-dfaf-4bc4-92ca-bb7bc158f4ca None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:38.394362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca43ad8-4b06-496d-8c03-ff207296f89b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:38.444278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e7a3-95ad-4571-b225-9b016d7e8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:38.445716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e7a3-95ad-4571-b225-9b016d7e8e47 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.446216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e7a3-95ad-4571-b225-9b016d7e8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.446695 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5e7a3-95ad-4571-b225-9b016d7e8e47 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.448919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e7a3-95ad-4571-b225-9b016d7e8e47 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:38.451606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5e7a3-95ad-4571-b225-9b016d7e8e47 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:38.454701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 59/123] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:38 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:38.455834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e7a3-95ad-4571-b225-9b016d7e8e47 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:38.485240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe05730f-dfaf-4bc4-92ca-bb7bc158f4ca None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:38.522216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ee28d-1060-4f1f-853a-2a0090b35472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:38.522926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ee28d-1060-4f1f-853a-2a0090b35472 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.523264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ee28d-1060-4f1f-853a-2a0090b35472 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.523553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ee28d-1060-4f1f-853a-2a0090b35472 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.543377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:38.581364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5e7a3-95ad-4571-b225-9b016d7e8e47 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:38.597186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ee28d-1060-4f1f-853a-2a0090b35472 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:38.598599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ee28d-1060-4f1f-853a-2a0090b35472 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:38.621121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dab90-35d2-482f-817f-9fe3bbe850b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:38.621940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dab90-35d2-482f-817f-9fe3bbe850b6 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.622264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dab90-35d2-482f-817f-9fe3bbe850b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.622547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dab90-35d2-482f-817f-9fe3bbe850b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.639071 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95dab90-35d2-482f-817f-9fe3bbe850b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-a95dab90-35d2-482f-817f-9fe3bbe850b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:38.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:38.650234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:38.651373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:38.656348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 60/124] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:38:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:38.656996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dab90-35d2-482f-817f-9fe3bbe850b6 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:38.663388 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:38.722890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 65/125] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:38.723591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ee28d-1060-4f1f-853a-2a0090b35472 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:38.773444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:38.774710 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dab90-35d2-482f-817f-9fe3bbe850b6 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:38.817940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f7cd2-04d4-4442-98de-49caa95f7539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:38.819601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f7cd2-04d4-4442-98de-49caa95f7539 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.820087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f7cd2-04d4-4442-98de-49caa95f7539 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.820639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f7cd2-04d4-4442-98de-49caa95f7539 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.834829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ee28d-1060-4f1f-853a-2a0090b35472 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:38.836183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f7cd2-04d4-4442-98de-49caa95f7539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-298f7cd2-04d4-4442-98de-49caa95f7539 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:38.847384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:38.848261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:38.849027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:38.851603 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 61/126] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:38.852597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f7cd2-04d4-4442-98de-49caa95f7539 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:38.880456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac863db-7362-49f6-9302-758eed545c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:38.881539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac863db-7362-49f6-9302-758eed545c8d None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.882302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac863db-7362-49f6-9302-758eed545c8d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.882302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac863db-7362-49f6-9302-758eed545c8d None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020/users/4343916bc48d4b1596f21b7dfce5ddf4/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.884525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac863db-7362-49f6-9302-758eed545c8d None admin] RBAC: Authorizing `identity:create_grant(project_id=b3755fb9019c4a62a3376df0865a1020, user_id=4343916bc48d4b1596f21b7dfce5ddf4, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:38.886351 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac863db-7362-49f6-9302-758eed545c8d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:38.925094 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:38.961842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f7cd2-04d4-4442-98de-49caa95f7539 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:38.995180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b583-5f81-4cb6-bdc5-c72375fcb0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:38.995777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b583-5f81-4cb6-bdc5-c72375fcb0b9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:38.996047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b583-5f81-4cb6-bdc5-c72375fcb0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:38.996324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610b583-5f81-4cb6-bdc5-c72375fcb0b9 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:38.997097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610b583-5f81-4cb6-bdc5-c72375fcb0b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:38.997409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610b583-5f81-4cb6-bdc5-c72375fcb0b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:38.998790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610b583-5f81-4cb6-bdc5-c72375fcb0b9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:39.010996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 62/127] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:38:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:39.010996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b583-5f81-4cb6-bdc5-c72375fcb0b9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:39.068584 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 66/128] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:38:38 2022] PUT /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020/users/4343916bc48d4b1596f21b7dfce5ddf4/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:38:39.069809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac863db-7362-49f6-9302-758eed545c8d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:39.156603 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610b583-5f81-4cb6-bdc5-c72375fcb0b9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:39.205321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:39.223287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9865c8c-66fc-4f4a-a805-3db7a500dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:39.224824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9865c8c-66fc-4f4a-a805-3db7a500dd45 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:39.225823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9865c8c-66fc-4f4a-a805-3db7a500dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:39.226673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9865c8c-66fc-4f4a-a805-3db7a500dd45 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:39.228549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9865c8c-66fc-4f4a-a805-3db7a500dd45 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:39.230174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9865c8c-66fc-4f4a-a805-3db7a500dd45 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:39.232427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 63/129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:39 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:39.233773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9865c8c-66fc-4f4a-a805-3db7a500dd45 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:39.250315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac863db-7362-49f6-9302-758eed545c8d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:39.257226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:39.322858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0a2e5-e066-4aec-8566-b888125c4469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:39.323789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a2e5-e066-4aec-8566-b888125c4469 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:39.324222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a2e5-e066-4aec-8566-b888125c4469 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:39.324671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a2e5-e066-4aec-8566-b888125c4469 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:39.326162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0a2e5-e066-4aec-8566-b888125c4469 None admin] RBAC: Adding query filter params (name=member) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:39.326865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0a2e5-e066-4aec-8566-b888125c4469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:39.328569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0a2e5-e066-4aec-8566-b888125c4469 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:39.339801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 67/130] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:39.341474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0a2e5-e066-4aec-8566-b888125c4469 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:39.396144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9865c8c-66fc-4f4a-a805-3db7a500dd45 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:39.447136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb25e-76a5-4d1a-9948-dc75406d30ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:39.448025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb25e-76a5-4d1a-9948-dc75406d30ab None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:39.448314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb25e-76a5-4d1a-9948-dc75406d30ab None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:39.448595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fb25e-76a5-4d1a-9948-dc75406d30ab None admin] PATH_INFO: `/v3/users/b34cdcd2c3194a99b2b1075d635e61f4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:39.452143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fb25e-76a5-4d1a-9948-dc75406d30ab None admin] RBAC: Authorizing `identity:get_user(user_id=b34cdcd2c3194a99b2b1075d635e61f4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:39.453646 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fb25e-76a5-4d1a-9948-dc75406d30ab None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:39.456319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 64/131] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:39 2022] GET /identity/v3/users/b34cdcd2c3194a99b2b1075d635e61f4 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:39.457105 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb25e-76a5-4d1a-9948-dc75406d30ab None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:39.488566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0a2e5-e066-4aec-8566-b888125c4469 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:39.560275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ef507-1ce3-44dc-92a4-749e28e94da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:39.562389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ef507-1ce3-44dc-92a4-749e28e94da9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:39.562389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ef507-1ce3-44dc-92a4-749e28e94da9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:39.562389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ef507-1ce3-44dc-92a4-749e28e94da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:39.562634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ef507-1ce3-44dc-92a4-749e28e94da9 None admin] RBAC: Adding query filter params (role.id=bfe83dde5e854daeb7b29edf7171f8d7, scope.project.id=b3755fb9019c4a62a3376df0865a1020, user.id=5b5c2d1ca27e412f8ab327a40ff52efa) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:39.563624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ef507-1ce3-44dc-92a4-749e28e94da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:39.564336 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ef507-1ce3-44dc-92a4-749e28e94da9 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:39.573428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:39.579952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 68/132] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:39 2022] GET /identity/v3/role_assignments?user.id=5b5c2d1ca27e412f8ab327a40ff52efa&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=bfe83dde5e854daeb7b29edf7171f8d7 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:39.580793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ef507-1ce3-44dc-92a4-749e28e94da9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:39.647618 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:39.659729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fb25e-76a5-4d1a-9948-dc75406d30ab None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:39.723150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6c1b5-3b47-4dd9-a949-c5e05185e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:39.724029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6c1b5-3b47-4dd9-a949-c5e05185e97a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:39.724319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6c1b5-3b47-4dd9-a949-c5e05185e97a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:39.724600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6c1b5-3b47-4dd9-a949-c5e05185e97a None admin] PATH_INFO: `/v3/users/b34cdcd2c3194a99b2b1075d635e61f4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:39.725806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6c1b5-3b47-4dd9-a949-c5e05185e97a None admin] RBAC: Authorizing `identity:get_user(user_id=b34cdcd2c3194a99b2b1075d635e61f4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:39.727300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6c1b5-3b47-4dd9-a949-c5e05185e97a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:39.728941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 65/133] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:39 2022] GET /identity/v3/users/b34cdcd2c3194a99b2b1075d635e61f4 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:39.735469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6c1b5-3b47-4dd9-a949-c5e05185e97a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:39.813335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ef507-1ce3-44dc-92a4-749e28e94da9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:39.870546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6c1b5-3b47-4dd9-a949-c5e05185e97a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:39.920614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89f78d-6d1a-4459-be9d-a69eacbc58cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:39.921507 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89f78d-6d1a-4459-be9d-a69eacbc58cd None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:39.921799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89f78d-6d1a-4459-be9d-a69eacbc58cd None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:39.922345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89f78d-6d1a-4459-be9d-a69eacbc58cd None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:39.924627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89f78d-6d1a-4459-be9d-a69eacbc58cd None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:39.925137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:39.926118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89f78d-6d1a-4459-be9d-a69eacbc58cd None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:39.935146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 69/134] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:39 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:39.940247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89f78d-6d1a-4459-be9d-a69eacbc58cd None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:39.940868 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b844a-8b74-452b-a716-c747ab315d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:39.941829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b844a-8b74-452b-a716-c747ab315d20 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:39.942194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b844a-8b74-452b-a716-c747ab315d20 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:39.942545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b844a-8b74-452b-a716-c747ab315d20 None admin] PATH_INFO: `/v3/projects/54195529d2f944e9b2520c01b629b8f6` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:39.943885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b844a-8b74-452b-a716-c747ab315d20 None admin] RBAC: Authorizing `identity:get_project(project_id=54195529d2f944e9b2520c01b629b8f6)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:39.945510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b844a-8b74-452b-a716-c747ab315d20 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:39.947621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 66/135] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:39 2022] GET /identity/v3/projects/54195529d2f944e9b2520c01b629b8f6 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:39.954107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b844a-8b74-452b-a716-c747ab315d20 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:40.110123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b844a-8b74-452b-a716-c747ab315d20 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:40.151717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:40.158114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89f78d-6d1a-4459-be9d-a69eacbc58cd None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:40.171526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582b6e3-c741-4337-a7b0-550b2aca9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:40.172682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582b6e3-c741-4337-a7b0-550b2aca9a09 None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:40.172968 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582b6e3-c741-4337-a7b0-550b2aca9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:40.173244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582b6e3-c741-4337-a7b0-550b2aca9a09 None admin] PATH_INFO: `/v3/projects/54195529d2f944e9b2520c01b629b8f6/users/b34cdcd2c3194a99b2b1075d635e61f4/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:40.178284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582b6e3-c741-4337-a7b0-550b2aca9a09 None admin] RBAC: Authorizing `identity:create_grant(project_id=54195529d2f944e9b2520c01b629b8f6, user_id=b34cdcd2c3194a99b2b1075d635e61f4, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:40.179790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582b6e3-c741-4337-a7b0-550b2aca9a09 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:40.208779 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87aaf8-c30b-4a9b-8ee9-3dbaa88cb6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:40.209683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87aaf8-c30b-4a9b-8ee9-3dbaa88cb6fe None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:40.209970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87aaf8-c30b-4a9b-8ee9-3dbaa88cb6fe None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:40.210254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87aaf8-c30b-4a9b-8ee9-3dbaa88cb6fe None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020/users/b34cdcd2c3194a99b2b1075d635e61f4/roles/a97f5aba7e1b4044b2c749cba5d5708f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:40.212607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87aaf8-c30b-4a9b-8ee9-3dbaa88cb6fe None admin] RBAC: Authorizing `identity:create_grant(project_id=b3755fb9019c4a62a3376df0865a1020, user_id=b34cdcd2c3194a99b2b1075d635e61f4, role_id=a97f5aba7e1b4044b2c749cba5d5708f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:40.214076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87aaf8-c30b-4a9b-8ee9-3dbaa88cb6fe None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:40.313103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 67/136] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:38:39 2022] PUT /identity/v3/projects/54195529d2f944e9b2520c01b629b8f6/users/b34cdcd2c3194a99b2b1075d635e61f4/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:38:40.349714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 70/137] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:38:39 2022] PUT /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020/users/b34cdcd2c3194a99b2b1075d635e61f4/roles/a97f5aba7e1b4044b2c749cba5d5708f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:38:40.568421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff804-c5c3-4988-8df7-6c269f020deb None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:40.568958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff804-c5c3-4988-8df7-6c269f020deb None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:40.569058 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff804-c5c3-4988-8df7-6c269f020deb None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:40.570662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 68/138] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:40.580950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3e2e-01e6-466e-8774-c29e48685a74 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:40.581257 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3e2e-01e6-466e-8774-c29e48685a74 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:40.581518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3e2e-01e6-466e-8774-c29e48685a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:40.604977 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-b1af3e2e-01e6-466e-8774-c29e48685a74 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:40.606261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b1af3e2e-01e6-466e-8774-c29e48685a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:40.691944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 71/139] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:40.717973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff804-c5c3-4988-8df7-6c269f020deb None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:40.790721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:40.845421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff804-c5c3-4988-8df7-6c269f020deb None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:40.894637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c258d-4624-4991-b67c-daa96548b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:40.895507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c258d-4624-4991-b67c-daa96548b997 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:40.895795 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c258d-4624-4991-b67c-daa96548b997 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:40.896078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c258d-4624-4991-b67c-daa96548b997 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:40.912894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c258d-4624-4991-b67c-daa96548b997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-688c258d-4624-4991-b67c-daa96548b997 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:40.921218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:40.922327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:40.923119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 69/140] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:40.929323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3e2e-01e6-466e-8774-c29e48685a74 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:41.079552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:41.080233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0ea5-d49d-41dc-8938-016935758d69 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:41.080530 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0ea5-d49d-41dc-8938-016935758d69 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:41.080819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0ea5-d49d-41dc-8938-016935758d69 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:41.082318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 70/141] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:41.092755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3e2e-01e6-466e-8774-c29e48685a74 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:41.098501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e55226-55af-4987-ad51-c50151c5163d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:41.098741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e55226-55af-4987-ad51-c50151c5163d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:41.099068 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e55226-55af-4987-ad51-c50151c5163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:41.128179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-43e55226-55af-4987-ad51-c50151c5163d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:41.129442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-43e55226-55af-4987-ad51-c50151c5163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:41.151655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00936f-750a-41ca-bf8d-30d983dbc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:41.152336 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00936f-750a-41ca-bf8d-30d983dbc343 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:41.152618 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00936f-750a-41ca-bf8d-30d983dbc343 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:41.152894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00936f-750a-41ca-bf8d-30d983dbc343 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:41.154259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00936f-750a-41ca-bf8d-30d983dbc343 None admin] RBAC: Adding query filter params (name=member) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:41.154568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00936f-750a-41ca-bf8d-30d983dbc343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:41.160185 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00936f-750a-41ca-bf8d-30d983dbc343 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:41.193133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 72/142] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:41.198666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00936f-750a-41ca-bf8d-30d983dbc343 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:41.258902 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 71/143] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:41.282332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e55226-55af-4987-ad51-c50151c5163d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:41.337440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:41.399313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e55226-55af-4987-ad51-c50151c5163d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:41.437986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00936f-750a-41ca-bf8d-30d983dbc343 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:41.441523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cd448-4cf4-4fe1-b245-4f8f35231e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:41.442499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cd448-4cf4-4fe1-b245-4f8f35231e91 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:41.442960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cd448-4cf4-4fe1-b245-4f8f35231e91 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:41.443408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cd448-4cf4-4fe1-b245-4f8f35231e91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:41.445792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cd448-4cf4-4fe1-b245-4f8f35231e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:41.447577 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cd448-4cf4-4fe1-b245-4f8f35231e91 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:41.450236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 72/144] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:41.455707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cd448-4cf4-4fe1-b245-4f8f35231e91 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:41.519436 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0824a5-57f3-4e0e-b2d4-42c29a9e9baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:41.520318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0824a5-57f3-4e0e-b2d4-42c29a9e9baa None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:41.520604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0824a5-57f3-4e0e-b2d4-42c29a9e9baa None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:41.520876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0824a5-57f3-4e0e-b2d4-42c29a9e9baa None admin] PATH_INFO: `/v3/users/b34cdcd2c3194a99b2b1075d635e61f4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:41.522855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0824a5-57f3-4e0e-b2d4-42c29a9e9baa None admin] RBAC: Authorizing `identity:get_user(user_id=b34cdcd2c3194a99b2b1075d635e61f4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:41.524367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0824a5-57f3-4e0e-b2d4-42c29a9e9baa None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:41.526175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 73/145] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:41 2022] GET /identity/v3/users/b34cdcd2c3194a99b2b1075d635e61f4 => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:41.540368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0824a5-57f3-4e0e-b2d4-42c29a9e9baa None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:41.596196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:41.606900 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cd448-4cf4-4fe1-b245-4f8f35231e91 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:41.627350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:41.664818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033880b-d83f-47c3-98c2-dfa215b4b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:41.665472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033880b-d83f-47c3-98c2-dfa215b4b256 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:41.665805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033880b-d83f-47c3-98c2-dfa215b4b256 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:41.666090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033880b-d83f-47c3-98c2-dfa215b4b256 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:41.666821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033880b-d83f-47c3-98c2-dfa215b4b256 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:41.670016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033880b-d83f-47c3-98c2-dfa215b4b256 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:41.738929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0824a5-57f3-4e0e-b2d4-42c29a9e9baa None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:41.780012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 73/146] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:38:41 2022] POST /identity/v3/users => generated 283 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:38:41.799839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e76ee4-da7f-4775-9803-41931400dd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:41.800534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76ee4-da7f-4775-9803-41931400dd40 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:41.800823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76ee4-da7f-4775-9803-41931400dd40 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:41.801102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76ee4-da7f-4775-9803-41931400dd40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:41.898828 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e76ee4-da7f-4775-9803-41931400dd40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:41.900397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e76ee4-da7f-4775-9803-41931400dd40 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:41.928772 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:42.034453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 74/147] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 13:38:42.039845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033880b-d83f-47c3-98c2-dfa215b4b256 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:42.196115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033880b-d83f-47c3-98c2-dfa215b4b256 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:42.248295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a94df-3900-4063-99eb-e43dd52c6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:42.249548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a94df-3900-4063-99eb-e43dd52c6404 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:42.250060 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a94df-3900-4063-99eb-e43dd52c6404 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:42.250538 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a94df-3900-4063-99eb-e43dd52c6404 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:42.252079 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a94df-3900-4063-99eb-e43dd52c6404 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:42.253780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a94df-3900-4063-99eb-e43dd52c6404 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:42.255743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 74/148] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:42 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:42.261510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e76ee4-da7f-4775-9803-41931400dd40 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:42.404112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e76ee4-da7f-4775-9803-41931400dd40 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:42.427406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:42.431420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962718-3dec-41d5-995d-deb0fd182471 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:42.431713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962718-3dec-41d5-995d-deb0fd182471 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:42.431995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962718-3dec-41d5-995d-deb0fd182471 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:42.433381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 75/149] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:42.442483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6123-7fb8-489e-92e8-f825d3b710ba None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:42.442770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6123-7fb8-489e-92e8-f825d3b710ba None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:42.443069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6123-7fb8-489e-92e8-f825d3b710ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:42.453402 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228ce5b-7960-46bf-b7b2-1b3341dd7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:42.454015 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228ce5b-7960-46bf-b7b2-1b3341dd7228 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:42.454264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228ce5b-7960-46bf-b7b2-1b3341dd7228 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:42.454537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228ce5b-7960-46bf-b7b2-1b3341dd7228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:42.455409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228ce5b-7960-46bf-b7b2-1b3341dd7228 None admin] RBAC: Adding query filter params (role.id=1067c35f1111496c983a6a7dec2a5ad9, scope.project.id=b3755fb9019c4a62a3376df0865a1020, user.id=b34cdcd2c3194a99b2b1075d635e61f4) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:42.455720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228ce5b-7960-46bf-b7b2-1b3341dd7228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:42.457243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228ce5b-7960-46bf-b7b2-1b3341dd7228 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:42.463137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0d1d6123-7fb8-489e-92e8-f825d3b710ba None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:42.464787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0d1d6123-7fb8-489e-92e8-f825d3b710ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:42.468785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 75/150] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:42 2022] GET /identity/v3/role_assignments?user.id=b34cdcd2c3194a99b2b1075d635e61f4&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:42.522650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:42.583352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 76/151] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:42.605197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228ce5b-7960-46bf-b7b2-1b3341dd7228 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:42.715294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228ce5b-7960-46bf-b7b2-1b3341dd7228 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:42.752056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d39b7-826f-4bd6-b301-0115983ab7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:42.752872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d39b7-826f-4bd6-b301-0115983ab7c7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:42.753157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d39b7-826f-4bd6-b301-0115983ab7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:42.753434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d39b7-826f-4bd6-b301-0115983ab7c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:42.764854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d39b7-826f-4bd6-b301-0115983ab7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-049d39b7-826f-4bd6-b301-0115983ab7c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:42.772550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:42.773438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:42.774201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 76/152] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:42.780598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6123-7fb8-489e-92e8-f825d3b710ba None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:42.887097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46fbac-2cc6-40c8-993d-032ac546fd6b None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:42.887403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46fbac-2cc6-40c8-993d-032ac546fd6b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:42.888195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46fbac-2cc6-40c8-993d-032ac546fd6b None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:42.889585 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 77/153] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:38:42.897099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6123-7fb8-489e-92e8-f825d3b710ba None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:42.898101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba75e93-981a-4463-b217-a37f4c57bebe None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:42.898391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba75e93-981a-4463-b217-a37f4c57bebe None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:42.898670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba75e93-981a-4463-b217-a37f4c57bebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:42.922724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-cba75e93-981a-4463-b217-a37f4c57bebe None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:42.923963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-cba75e93-981a-4463-b217-a37f4c57bebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:42.946862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193f160-a27e-4acd-be80-03ce4637dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:42.947958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193f160-a27e-4acd-be80-03ce4637dc4d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:42.949627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193f160-a27e-4acd-be80-03ce4637dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:42.950045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193f160-a27e-4acd-be80-03ce4637dc4d None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:42.951761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193f160-a27e-4acd-be80-03ce4637dc4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:42.953111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193f160-a27e-4acd-be80-03ce4637dc4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:42.957339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193f160-a27e-4acd-be80-03ce4637dc4d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:42.970926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 77/154] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:42.977983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193f160-a27e-4acd-be80-03ce4637dc4d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:42.990120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:43.033962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 78/155] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:43.045556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:43.086094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba75e93-981a-4463-b217-a37f4c57bebe None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:43.169416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193f160-a27e-4acd-be80-03ce4637dc4d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:43.239664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083422e-f9bc-4be2-914f-4309667c6fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:43.241735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083422e-f9bc-4be2-914f-4309667c6fc4 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:43.243534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083422e-f9bc-4be2-914f-4309667c6fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:43.243962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083422e-f9bc-4be2-914f-4309667c6fc4 None admin] PATH_INFO: `/v3/users/4343916bc48d4b1596f21b7dfce5ddf4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:43.245543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083422e-f9bc-4be2-914f-4309667c6fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=4343916bc48d4b1596f21b7dfce5ddf4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:43.248585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083422e-f9bc-4be2-914f-4309667c6fc4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:43.250438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 78/156] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:42 2022] GET /identity/v3/users/4343916bc48d4b1596f21b7dfce5ddf4 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:43.256301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083422e-f9bc-4be2-914f-4309667c6fc4 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:43.287691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba75e93-981a-4463-b217-a37f4c57bebe None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:43.348265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131257f-d8a1-4821-b6d6-40d4b63570f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:43.348663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131257f-d8a1-4821-b6d6-40d4b63570f9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:43.348977 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131257f-d8a1-4821-b6d6-40d4b63570f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:43.349231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131257f-d8a1-4821-b6d6-40d4b63570f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:43.371947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131257f-d8a1-4821-b6d6-40d4b63570f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-7131257f-d8a1-4821-b6d6-40d4b63570f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:43.380683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:43.381562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:43.382470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 79/157] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:43.393387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131257f-d8a1-4821-b6d6-40d4b63570f9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:43.411606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:43.416327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083422e-f9bc-4be2-914f-4309667c6fc4 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:43.464878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:43.467288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6302ad-1ac2-403c-9751-a47a385e8777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:43.467961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6302ad-1ac2-403c-9751-a47a385e8777 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:43.468244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6302ad-1ac2-403c-9751-a47a385e8777 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:43.468519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6302ad-1ac2-403c-9751-a47a385e8777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:43.557443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6302ad-1ac2-403c-9751-a47a385e8777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:43.558911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6302ad-1ac2-403c-9751-a47a385e8777 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:43.574255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131257f-d8a1-4821-b6d6-40d4b63570f9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:43.633822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e5cce-0289-4011-8014-0ec2571906fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:43.634499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e5cce-0289-4011-8014-0ec2571906fc None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:43.634781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e5cce-0289-4011-8014-0ec2571906fc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:43.635079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e5cce-0289-4011-8014-0ec2571906fc None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:43.635850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e5cce-0289-4011-8014-0ec2571906fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:43.636160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e5cce-0289-4011-8014-0ec2571906fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:43.637570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e5cce-0289-4011-8014-0ec2571906fc None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:43.654882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 80/158] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:43.660924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e5cce-0289-4011-8014-0ec2571906fc None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:43.722183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:43.735212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 79/159] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 13:38:43.736147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6302ad-1ac2-403c-9751-a47a385e8777 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:43.857471 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:43.867586 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6302ad-1ac2-403c-9751-a47a385e8777 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:43.874992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e5cce-0289-4011-8014-0ec2571906fc None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:43.951384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b30bd9-229c-47a5-b5eb-0bb970c371d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:43.952266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b30bd9-229c-47a5-b5eb-0bb970c371d4 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:43.952550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b30bd9-229c-47a5-b5eb-0bb970c371d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:43.952922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b30bd9-229c-47a5-b5eb-0bb970c371d4 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:43.954140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b30bd9-229c-47a5-b5eb-0bb970c371d4 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:43.955742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b30bd9-229c-47a5-b5eb-0bb970c371d4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:43.956560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030d0d8-ad17-4125-ac15-d100d3700615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:43.957466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 80/160] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:43 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:43.957750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030d0d8-ad17-4125-ac15-d100d3700615 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:43.958043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030d0d8-ad17-4125-ac15-d100d3700615 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:43.958320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030d0d8-ad17-4125-ac15-d100d3700615 None admin] PATH_INFO: `/v3/users/5b5c2d1ca27e412f8ab327a40ff52efa` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:43.958637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3474038-0c51-4d0c-816c-e808256088ff None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:43.958921 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3474038-0c51-4d0c-816c-e808256088ff None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:43.959622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030d0d8-ad17-4125-ac15-d100d3700615 None admin] RBAC: Authorizing `identity:get_user(user_id=5b5c2d1ca27e412f8ab327a40ff52efa)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:43.961075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030d0d8-ad17-4125-ac15-d100d3700615 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:43.967339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 81/161] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:43 2022] GET /identity/v3/users/5b5c2d1ca27e412f8ab327a40ff52efa => generated 289 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:43.967508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3474038-0c51-4d0c-816c-e808256088ff None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:43.968813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 81/162] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:43.969076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030d0d8-ad17-4125-ac15-d100d3700615 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:43.972487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3474038-0c51-4d0c-816c-e808256088ff None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:44.110899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:44.151286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3474038-0c51-4d0c-816c-e808256088ff None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:44.188916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2ec7c-79c7-4371-8dc6-6522d303ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:44.189774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ec7c-79c7-4371-8dc6-6522d303ef7b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:44.190058 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ec7c-79c7-4371-8dc6-6522d303ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:44.190334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ec7c-79c7-4371-8dc6-6522d303ef7b None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:44.191532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2ec7c-79c7-4371-8dc6-6522d303ef7b None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:44.193390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2ec7c-79c7-4371-8dc6-6522d303ef7b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:44.195117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 82/163] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:43 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:44.196406 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a45d-3754-42d6-8709-dee73bf09ad0 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:44.196694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a45d-3754-42d6-8709-dee73bf09ad0 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:44.196968 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418a45d-3754-42d6-8709-dee73bf09ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:44.215190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f418a45d-3754-42d6-8709-dee73bf09ad0 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:44.217750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f418a45d-3754-42d6-8709-dee73bf09ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:44.222142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030d0d8-ad17-4125-ac15-d100d3700615 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:44.297531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6897feb-4ae7-4b48-a361-5c83524f3f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:44.298200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6897feb-4ae7-4b48-a361-5c83524f3f7a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:44.298481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6897feb-4ae7-4b48-a361-5c83524f3f7a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:44.298755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6897feb-4ae7-4b48-a361-5c83524f3f7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:44.299639 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6897feb-4ae7-4b48-a361-5c83524f3f7a None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=b3755fb9019c4a62a3376df0865a1020, user.id=4343916bc48d4b1596f21b7dfce5ddf4) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:44.299949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6897feb-4ae7-4b48-a361-5c83524f3f7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:44.301410 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6897feb-4ae7-4b48-a361-5c83524f3f7a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:44.317808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 82/164] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:43 2022] GET /identity/v3/role_assignments?user.id=4343916bc48d4b1596f21b7dfce5ddf4&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=3951cc86a51d416fafc5676d456e79ce => generated 608 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:44.324976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb51e5-5783-4603-a689-58864c9f4195 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:44.325854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb51e5-5783-4603-a689-58864c9f4195 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:44.326311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb51e5-5783-4603-a689-58864c9f4195 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:44.327937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 83/165] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:44.328494 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb51e5-5783-4603-a689-58864c9f4195 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:44.356994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 83/166] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:44.358405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c4f6-db03-4aa1-a990-de234c4fc183 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:44.358699 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c4f6-db03-4aa1-a990-de234c4fc183 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:44.361590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c4f6-db03-4aa1-a990-de234c4fc183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:44.392760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8be1c4f6-db03-4aa1-a990-de234c4fc183 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:44.395189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8be1c4f6-db03-4aa1-a990-de234c4fc183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:44.411500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:44.499342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:44.510497 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 84/167] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:44.511411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1c4f6-db03-4aa1-a990-de234c4fc183 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:44.570549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb51e5-5783-4603-a689-58864c9f4195 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:44.632159 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f00956-76de-4881-ba97-058291010c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:44.633458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f00956-76de-4881-ba97-058291010c93 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:44.633966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f00956-76de-4881-ba97-058291010c93 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:44.634442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f00956-76de-4881-ba97-058291010c93 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020/users/5b5c2d1ca27e412f8ab327a40ff52efa/roles/bfe83dde5e854daeb7b29edf7171f8d7` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:44.637125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f00956-76de-4881-ba97-058291010c93 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3755fb9019c4a62a3376df0865a1020, user_id=5b5c2d1ca27e412f8ab327a40ff52efa, role_id=bfe83dde5e854daeb7b29edf7171f8d7)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:44.639673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f00956-76de-4881-ba97-058291010c93 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:44.725847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 84/168] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:38:44 2022] PUT /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020/users/5b5c2d1ca27e412f8ab327a40ff52efa/roles/bfe83dde5e854daeb7b29edf7171f8d7 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:38:44.727106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f00956-76de-4881-ba97-058291010c93 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:44.732806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1c4f6-db03-4aa1-a990-de234c4fc183 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:44.784459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b8c35-cefe-47ba-832c-5c68e114f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:44.785648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b8c35-cefe-47ba-832c-5c68e114f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:44.785938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b8c35-cefe-47ba-832c-5c68e114f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:44.787077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b8c35-cefe-47ba-832c-5c68e114f1a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:44.815264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b8c35-cefe-47ba-832c-5c68e114f1a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-b19b8c35-cefe-47ba-832c-5c68e114f1a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:44.833539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:44.834743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:44.835589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:44.839712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 85/169] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:38:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:44.846047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b8c35-cefe-47ba-832c-5c68e114f1a5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:44.928688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:44.947280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:44.986083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b8c35-cefe-47ba-832c-5c68e114f1a5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:44.993836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f00956-76de-4881-ba97-058291010c93 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:45.031046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50050b-3cb6-43f3-bddb-7db3752f6db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:45.032042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50050b-3cb6-43f3-bddb-7db3752f6db1 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:45.032547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50050b-3cb6-43f3-bddb-7db3752f6db1 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:45.033047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50050b-3cb6-43f3-bddb-7db3752f6db1 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:45.034483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50050b-3cb6-43f3-bddb-7db3752f6db1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:45.034874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50050b-3cb6-43f3-bddb-7db3752f6db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:45.036788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae50050b-3cb6-43f3-bddb-7db3752f6db1 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:45.047996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 86/170] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:38:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:45.054517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50050b-3cb6-43f3-bddb-7db3752f6db1 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:45.083761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fb0d6-16d4-4585-9e1e-01c804e04d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:45.084661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fb0d6-16d4-4585-9e1e-01c804e04d9a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:45.084865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fb0d6-16d4-4585-9e1e-01c804e04d9a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:45.085144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fb0d6-16d4-4585-9e1e-01c804e04d9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:45.111644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fb0d6-16d4-4585-9e1e-01c804e04d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-fc9fb0d6-16d4-4585-9e1e-01c804e04d9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:45.119594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:45.120482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:45.121300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 85/171] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:45.126818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fb0d6-16d4-4585-9e1e-01c804e04d9a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:45.176619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50050b-3cb6-43f3-bddb-7db3752f6db1 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:45.197064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:45.223133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dcd3a-a0b9-4862-887b-c6dc5e788d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:45.224361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dcd3a-a0b9-4862-887b-c6dc5e788d4f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:45.228957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dcd3a-a0b9-4862-887b-c6dc5e788d4f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:45.229531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dcd3a-a0b9-4862-887b-c6dc5e788d4f None admin] PATH_INFO: `/v3/users/b34cdcd2c3194a99b2b1075d635e61f4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:45.232124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dcd3a-a0b9-4862-887b-c6dc5e788d4f None admin] RBAC: Authorizing `identity:get_user(user_id=b34cdcd2c3194a99b2b1075d635e61f4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:45.233801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99dcd3a-a0b9-4862-887b-c6dc5e788d4f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:45.237507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 87/172] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:45 2022] GET /identity/v3/users/b34cdcd2c3194a99b2b1075d635e61f4 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:45.261891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dcd3a-a0b9-4862-887b-c6dc5e788d4f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:45.330006 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fb0d6-16d4-4585-9e1e-01c804e04d9a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:45.396986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dcd3a-a0b9-4862-887b-c6dc5e788d4f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:45.441665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe21f-aad4-478f-b4d8-4df731899d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:45.442679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe21f-aad4-478f-b4d8-4df731899d29 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:45.443190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe21f-aad4-478f-b4d8-4df731899d29 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:45.443770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfe21f-aad4-478f-b4d8-4df731899d29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:45.472305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c923a5-7810-44fe-8008-efa0a97c1d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:45.472982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c923a5-7810-44fe-8008-efa0a97c1d14 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:45.473267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c923a5-7810-44fe-8008-efa0a97c1d14 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:45.473544 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c923a5-7810-44fe-8008-efa0a97c1d14 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:45.474307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c923a5-7810-44fe-8008-efa0a97c1d14 None admin] RBAC: Adding query filter params (name=member) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:45.474614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c923a5-7810-44fe-8008-efa0a97c1d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:45.476078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c923a5-7810-44fe-8008-efa0a97c1d14 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:45.500983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 86/173] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:45.506367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c923a5-7810-44fe-8008-efa0a97c1d14 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:45.507352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:45.522141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfe21f-aad4-478f-b4d8-4df731899d29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:45.524881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfe21f-aad4-478f-b4d8-4df731899d29 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:45.546670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:45.680539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 88/174] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 13:38:45.690219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe21f-aad4-478f-b4d8-4df731899d29 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:45.873234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c923a5-7810-44fe-8008-efa0a97c1d14 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:45.925788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:45.948928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed50fd-ee13-4197-a50f-e08b2608eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:45.950711 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed50fd-ee13-4197-a50f-e08b2608eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:45.951265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed50fd-ee13-4197-a50f-e08b2608eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:45.951745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed50fd-ee13-4197-a50f-e08b2608eeb4 None admin] PATH_INFO: `/v3/users/b34cdcd2c3194a99b2b1075d635e61f4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:45.953194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed50fd-ee13-4197-a50f-e08b2608eeb4 None admin] RBAC: Authorizing `identity:get_user(user_id=b34cdcd2c3194a99b2b1075d635e61f4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:45.954871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed50fd-ee13-4197-a50f-e08b2608eeb4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:45.956770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 87/175] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:45 2022] GET /identity/v3/users/b34cdcd2c3194a99b2b1075d635e61f4 => generated 275 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:45.964489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfe21f-aad4-478f-b4d8-4df731899d29 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:45.965613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef31f6-3824-4d60-ba4e-c33b4bd5e69e None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:45.966837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef31f6-3824-4d60-ba4e-c33b4bd5e69e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:45.968319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef31f6-3824-4d60-ba4e-c33b4bd5e69e None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:45.972208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 88/176] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:45.973168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef31f6-3824-4d60-ba4e-c33b4bd5e69e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:46.042950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53799cec-4f36-4082-96f0-f006def587a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:46.045033 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53799cec-4f36-4082-96f0-f006def587a2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.048551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53799cec-4f36-4082-96f0-f006def587a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.049049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53799cec-4f36-4082-96f0-f006def587a2 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.050741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53799cec-4f36-4082-96f0-f006def587a2 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:46.053427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53799cec-4f36-4082-96f0-f006def587a2 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:46.058021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 89/177] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:45 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:46.061131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc39a-92be-43be-8152-5ccfbc6e8043 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.061982 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc39a-92be-43be-8152-5ccfbc6e8043 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.063972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afc39a-92be-43be-8152-5ccfbc6e8043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.094766 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-11afc39a-92be-43be-8152-5ccfbc6e8043 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:46.098832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-11afc39a-92be-43be-8152-5ccfbc6e8043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:46.119375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:46.157098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef31f6-3824-4d60-ba4e-c33b4bd5e69e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:46.220234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 90/178] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:46.228170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc39a-92be-43be-8152-5ccfbc6e8043 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:46.239622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f56f688-328c-48cd-98e8-cfed668c206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:46.240285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f688-328c-48cd-98e8-cfed668c206c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.240565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f688-328c-48cd-98e8-cfed668c206c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.240833 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f56f688-328c-48cd-98e8-cfed668c206c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.349521 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56f688-328c-48cd-98e8-cfed668c206c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:46.350646 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:46.351536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f56f688-328c-48cd-98e8-cfed668c206c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:46.368979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afc39a-92be-43be-8152-5ccfbc6e8043 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:46.406944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b7ab-41f1-48b1-881b-5cefdbed847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:46.407678 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b7ab-41f1-48b1-881b-5cefdbed847d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.407908 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b7ab-41f1-48b1-881b-5cefdbed847d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.408180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b7ab-41f1-48b1-881b-5cefdbed847d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.409008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b7ab-41f1-48b1-881b-5cefdbed847d None admin] RBAC: Adding query filter params (role.id=a97f5aba7e1b4044b2c749cba5d5708f, scope.project.id=b3755fb9019c4a62a3376df0865a1020, user.id=b34cdcd2c3194a99b2b1075d635e61f4) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:46.409316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b7ab-41f1-48b1-881b-5cefdbed847d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:46.410756 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b7ab-41f1-48b1-881b-5cefdbed847d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:46.416598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 91/179] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:46 2022] GET /identity/v3/role_assignments?user.id=b34cdcd2c3194a99b2b1075d635e61f4&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=a97f5aba7e1b4044b2c749cba5d5708f => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:46.417346 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b7ab-41f1-48b1-881b-5cefdbed847d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:46.444801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:46.471702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 89/180] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:46.473226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5fd3b-3213-4467-affe-7a2ec11da632 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.473581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5fd3b-3213-4467-affe-7a2ec11da632 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.473926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5fd3b-3213-4467-affe-7a2ec11da632 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.479171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 90/181] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:46.479171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0f91e-9f5d-4951-9e4b-29b5d21bfb09 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.479171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0f91e-9f5d-4951-9e4b-29b5d21bfb09 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.479171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0f91e-9f5d-4951-9e4b-29b5d21bfb09 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.479171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 91/182] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:46.479712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0f91e-9f5d-4951-9e4b-29b5d21bfb09 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:46.563255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b7ab-41f1-48b1-881b-5cefdbed847d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:46.603906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0f91e-9f5d-4951-9e4b-29b5d21bfb09 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:46.605103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110285f-07dc-44e7-88b1-204131de3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:46.605978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110285f-07dc-44e7-88b1-204131de3006 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.606863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110285f-07dc-44e7-88b1-204131de3006 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.607408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110285f-07dc-44e7-88b1-204131de3006 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.620652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110285f-07dc-44e7-88b1-204131de3006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-6110285f-07dc-44e7-88b1-204131de3006 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:46.629457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:46.630413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:46.631244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 92/183] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:46.636531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d9623-a45a-4a76-91e4-a73a75f41507 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.636890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d9623-a45a-4a76-91e4-a73a75f41507 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.637526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d9623-a45a-4a76-91e4-a73a75f41507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.651645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:46.657809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-118d9623-a45a-4a76-91e4-a73a75f41507 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:46.658935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-118d9623-a45a-4a76-91e4-a73a75f41507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:46.663720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607b176-5dfe-40bc-a5af-5389353e066e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:46.667057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607b176-5dfe-40bc-a5af-5389353e066e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.667057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607b176-5dfe-40bc-a5af-5389353e066e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.667057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607b176-5dfe-40bc-a5af-5389353e066e None admin] PATH_INFO: `/v3/projects/54195529d2f944e9b2520c01b629b8f6` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.667057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607b176-5dfe-40bc-a5af-5389353e066e None admin] RBAC: Authorizing `identity:get_project(project_id=54195529d2f944e9b2520c01b629b8f6)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:46.668158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607b176-5dfe-40bc-a5af-5389353e066e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:46.671953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 92/184] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:46 2022] GET /identity/v3/projects/54195529d2f944e9b2520c01b629b8f6 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:46.673382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d517df-0fd7-4442-a44e-51eff56f8ae9 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.673671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d517df-0fd7-4442-a44e-51eff56f8ae9 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.673971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d517df-0fd7-4442-a44e-51eff56f8ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.694083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-68d517df-0fd7-4442-a44e-51eff56f8ae9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:46.695513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-68d517df-0fd7-4442-a44e-51eff56f8ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:46.747683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 93/185] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:46.748890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d9623-a45a-4a76-91e4-a73a75f41507 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:46.758088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:46.797376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 93/186] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:46.798361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d517df-0fd7-4442-a44e-51eff56f8ae9 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:46.855572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d9623-a45a-4a76-91e4-a73a75f41507 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:46.892623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccb854-a34d-4479-99bd-72fe10ab4bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:46.893403 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccb854-a34d-4479-99bd-72fe10ab4bac None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.893760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccb854-a34d-4479-99bd-72fe10ab4bac None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.894110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccb854-a34d-4479-99bd-72fe10ab4bac None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.894953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccb854-a34d-4479-99bd-72fe10ab4bac None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:46.895369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccb854-a34d-4479-99bd-72fe10ab4bac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:46.896818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccb854-a34d-4479-99bd-72fe10ab4bac None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:46.899348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:46.911507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 94/187] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:46.911507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccb854-a34d-4479-99bd-72fe10ab4bac None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:46.924016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d517df-0fd7-4442-a44e-51eff56f8ae9 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:46.958368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905c120-ac3b-42a4-9349-3f3e9d3236bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:46.959058 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905c120-ac3b-42a4-9349-3f3e9d3236bf None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:46.959345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905c120-ac3b-42a4-9349-3f3e9d3236bf None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:46.959622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905c120-ac3b-42a4-9349-3f3e9d3236bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:46.960465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905c120-ac3b-42a4-9349-3f3e9d3236bf None admin] RBAC: Adding query filter params (role.id=1067c35f1111496c983a6a7dec2a5ad9, scope.project.id=54195529d2f944e9b2520c01b629b8f6, user.id=b34cdcd2c3194a99b2b1075d635e61f4) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:46.960779 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905c120-ac3b-42a4-9349-3f3e9d3236bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:46.962242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905c120-ac3b-42a4-9349-3f3e9d3236bf None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:46.968645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 94/188] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:46 2022] GET /identity/v3/role_assignments?user.id=b34cdcd2c3194a99b2b1075d635e61f4&scope.project.id=54195529d2f944e9b2520c01b629b8f6&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:46.969436 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905c120-ac3b-42a4-9349-3f3e9d3236bf None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:47.037412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:47.037610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccb854-a34d-4479-99bd-72fe10ab4bac None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:47.088193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd1e19-273a-4870-a825-ea336aec2734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:47.089715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd1e19-273a-4870-a825-ea336aec2734 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:47.090372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd1e19-273a-4870-a825-ea336aec2734 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:47.090953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd1e19-273a-4870-a825-ea336aec2734 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:47.106949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd1e19-273a-4870-a825-ea336aec2734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:47.113812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905c120-ac3b-42a4-9349-3f3e9d3236bf None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-53cd1e19-273a-4870-a825-ea336aec2734 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:47.118722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:47.119957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:47.120944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:47.124198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 95/189] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:38:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:47.129533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd1e19-273a-4870-a825-ea336aec2734 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:47.170776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31171-212e-4589-8f10-13aa1942c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:47.170776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31171-212e-4589-8f10-13aa1942c84e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:47.170776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31171-212e-4589-8f10-13aa1942c84e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:47.171793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa31171-212e-4589-8f10-13aa1942c84e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:47.173504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa31171-212e-4589-8f10-13aa1942c84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:47.175678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa31171-212e-4589-8f10-13aa1942c84e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:47.177488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 95/190] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:47.178540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31171-212e-4589-8f10-13aa1942c84e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:47.206586 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:47.268848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd1e19-273a-4870-a825-ea336aec2734 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:47.303965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa31171-212e-4589-8f10-13aa1942c84e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:47.308066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc450a-0dea-4e4a-839e-fbf919695e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:47.309246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc450a-0dea-4e4a-839e-fbf919695e2b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:47.310629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc450a-0dea-4e4a-839e-fbf919695e2b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:47.311156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc450a-0dea-4e4a-839e-fbf919695e2b None admin] PATH_INFO: `/v3/users/37556d4edbe24d7286181126851d570c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:47.312493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:47.326347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc450a-0dea-4e4a-839e-fbf919695e2b None admin] RBAC: Authorizing `identity:get_user(user_id=37556d4edbe24d7286181126851d570c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:47.327903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc450a-0dea-4e4a-839e-fbf919695e2b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:47.329660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 96/191] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:47 2022] GET /identity/v3/users/37556d4edbe24d7286181126851d570c => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:47.330405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc450a-0dea-4e4a-839e-fbf919695e2b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:47.346286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce145f-218e-488f-a610-f3fad4c242d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:47.347515 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce145f-218e-488f-a610-f3fad4c242d2 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:47.347803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce145f-218e-488f-a610-f3fad4c242d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:47.348080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce145f-218e-488f-a610-f3fad4c242d2 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:47.348944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce145f-218e-488f-a610-f3fad4c242d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:47.349254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce145f-218e-488f-a610-f3fad4c242d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:47.350929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce145f-218e-488f-a610-f3fad4c242d2 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:47.360842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 96/192] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:38:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:47.366257 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce145f-218e-488f-a610-f3fad4c242d2 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:47.434602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc450a-0dea-4e4a-839e-fbf919695e2b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:47.451528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:47.471369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257e2c5-6ea5-4074-8dff-0cd43963799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:47.479707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257e2c5-6ea5-4074-8dff-0cd43963799e None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:47.479707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257e2c5-6ea5-4074-8dff-0cd43963799e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:47.479707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257e2c5-6ea5-4074-8dff-0cd43963799e None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:47.479707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257e2c5-6ea5-4074-8dff-0cd43963799e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:47.479707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257e2c5-6ea5-4074-8dff-0cd43963799e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:47.480536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce145f-218e-488f-a610-f3fad4c242d2 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:47.518943 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4be521-fe3b-49a6-9419-4631ce42c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:47.519630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be521-fe3b-49a6-9419-4631ce42c665 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:47.519919 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be521-fe3b-49a6-9419-4631ce42c665 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:47.520194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4be521-fe3b-49a6-9419-4631ce42c665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:47.555143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:47.587768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4be521-fe3b-49a6-9419-4631ce42c665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:47.589228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4be521-fe3b-49a6-9419-4631ce42c665 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:47.600505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 97/193] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:38:47 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:38:47.601949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257e2c5-6ea5-4074-8dff-0cd43963799e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:47.716586 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 97/194] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:47.717829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9be3ee-8aa0-4689-b08b-a71bb3ade5be None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:47.718120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9be3ee-8aa0-4689-b08b-a71bb3ade5be None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:47.718398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9be3ee-8aa0-4689-b08b-a71bb3ade5be None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:47.723014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 98/195] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:47.723014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9be3ee-8aa0-4689-b08b-a71bb3ade5be None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:47.742806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257e2c5-6ea5-4074-8dff-0cd43963799e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:47.783837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1e571-cbf6-4d9f-8a87-e522a89762d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:47.784758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1e571-cbf6-4d9f-8a87-e522a89762d8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:47.785111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1e571-cbf6-4d9f-8a87-e522a89762d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:47.785430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1e571-cbf6-4d9f-8a87-e522a89762d8 None admin] PATH_INFO: `/v3/users/37556d4edbe24d7286181126851d570c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:47.786852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1e571-cbf6-4d9f-8a87-e522a89762d8 None admin] RBAC: Authorizing `identity:get_user(user_id=37556d4edbe24d7286181126851d570c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:47.788367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1e571-cbf6-4d9f-8a87-e522a89762d8 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:47.794618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 98/196] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:47 2022] GET /identity/v3/users/37556d4edbe24d7286181126851d570c => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:47.794618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6e952-c994-47b2-a620-c6cdddcf032b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:47.794618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6e952-c994-47b2-a620-c6cdddcf032b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:47.794618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6e952-c994-47b2-a620-c6cdddcf032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:47.808032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:47.812231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f0c6e952-c994-47b2-a620-c6cdddcf032b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:47.813884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f0c6e952-c994-47b2-a620-c6cdddcf032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:47.849127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9be3ee-8aa0-4689-b08b-a71bb3ade5be None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:47.854185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:47.892870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 99/197] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:47.893894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6e952-c994-47b2-a620-c6cdddcf032b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:47.894891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6aa4d-10b2-446b-9998-7eb9fbdcbe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:47.895817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6aa4d-10b2-446b-9998-7eb9fbdcbe16 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:47.896261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6aa4d-10b2-446b-9998-7eb9fbdcbe16 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:47.896449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6aa4d-10b2-446b-9998-7eb9fbdcbe16 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:47.897669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6aa4d-10b2-446b-9998-7eb9fbdcbe16 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:47.899189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6aa4d-10b2-446b-9998-7eb9fbdcbe16 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:47.900914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 99/198] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:47 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:47.909359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6aa4d-10b2-446b-9998-7eb9fbdcbe16 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:48.022198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6e952-c994-47b2-a620-c6cdddcf032b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:48.048272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6aa4d-10b2-446b-9998-7eb9fbdcbe16 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:48.065453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4167a4-4281-4c4b-9ba1-a8dda4eecdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:48.066899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4167a4-4281-4c4b-9ba1-a8dda4eecdb0 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:48.067533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4167a4-4281-4c4b-9ba1-a8dda4eecdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:48.068045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4167a4-4281-4c4b-9ba1-a8dda4eecdb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:48.094765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934d478-792c-4591-9480-10e91736bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:48.095512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934d478-792c-4591-9480-10e91736bf12 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:48.095793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934d478-792c-4591-9480-10e91736bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:48.096063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934d478-792c-4591-9480-10e91736bf12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:48.097196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934d478-792c-4591-9480-10e91736bf12 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c, user.id=37556d4edbe24d7286181126851d570c) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:48.097510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934d478-792c-4591-9480-10e91736bf12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:48.099757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934d478-792c-4591-9480-10e91736bf12 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:48.103877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:48.108681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 100/199] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:47 2022] GET /identity/v3/role_assignments?user.id=37556d4edbe24d7286181126851d570c&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=3951cc86a51d416fafc5676d456e79ce => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:48.111916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934d478-792c-4591-9480-10e91736bf12 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:48.124784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:48.190652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4167a4-4281-4c4b-9ba1-a8dda4eecdb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:48.192465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4167a4-4281-4c4b-9ba1-a8dda4eecdb0 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:48.299630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934d478-792c-4591-9480-10e91736bf12 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:48.357101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 100/200] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:48.364358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4167a4-4281-4c4b-9ba1-a8dda4eecdb0 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:48.377242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee272d-d8df-438e-ac8a-0135fa4f7f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:48.378045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee272d-d8df-438e-ac8a-0135fa4f7f3f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:48.378323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee272d-d8df-438e-ac8a-0135fa4f7f3f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:48.378589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee272d-d8df-438e-ac8a-0135fa4f7f3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:48.394345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee272d-d8df-438e-ac8a-0135fa4f7f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-3eee272d-d8df-438e-ac8a-0135fa4f7f3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:48.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:48.408408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:38:48.409207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:48.411796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 101/201] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:48.417364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee272d-d8df-438e-ac8a-0135fa4f7f3f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:48.479585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:48.530236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:48.538922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4167a4-4281-4c4b-9ba1-a8dda4eecdb0 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:48.611015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454b87b-5deb-4b14-b0c8-fffaac738515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:48.613172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454b87b-5deb-4b14-b0c8-fffaac738515 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:48.613833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454b87b-5deb-4b14-b0c8-fffaac738515 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:48.615111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454b87b-5deb-4b14-b0c8-fffaac738515 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:48.617485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454b87b-5deb-4b14-b0c8-fffaac738515 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:48.620303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454b87b-5deb-4b14-b0c8-fffaac738515 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:48.622838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 101/202] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:48 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:48.629891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee272d-d8df-438e-ac8a-0135fa4f7f3f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:48.633007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454b87b-5deb-4b14-b0c8-fffaac738515 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:48.704509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b990a7-279d-4551-b4c4-48d67cc6297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:48.706330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b990a7-279d-4551-b4c4-48d67cc6297f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:48.708293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b990a7-279d-4551-b4c4-48d67cc6297f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:48.708805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b990a7-279d-4551-b4c4-48d67cc6297f None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:48.709782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b990a7-279d-4551-b4c4-48d67cc6297f None admin] RBAC: Adding query filter params (name=reader) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:48.712066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b990a7-279d-4551-b4c4-48d67cc6297f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:48.713678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b990a7-279d-4551-b4c4-48d67cc6297f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:48.739992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 102/203] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:48.745293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b990a7-279d-4551-b4c4-48d67cc6297f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:48.769526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454b87b-5deb-4b14-b0c8-fffaac738515 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:48.807592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38351a46-6d94-45d8-bdee-cb53e8d30910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:48.808226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38351a46-6d94-45d8-bdee-cb53e8d30910 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:48.808535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38351a46-6d94-45d8-bdee-cb53e8d30910 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:48.808841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38351a46-6d94-45d8-bdee-cb53e8d30910 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:48.810375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38351a46-6d94-45d8-bdee-cb53e8d30910 None admin] RBAC: Adding query filter params (role.id=a97f5aba7e1b4044b2c749cba5d5708f, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c, user.id=37556d4edbe24d7286181126851d570c) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:48.810934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38351a46-6d94-45d8-bdee-cb53e8d30910 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:48.812759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38351a46-6d94-45d8-bdee-cb53e8d30910 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:48.827739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 102/204] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:48 2022] GET /identity/v3/role_assignments?user.id=37556d4edbe24d7286181126851d570c&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=a97f5aba7e1b4044b2c749cba5d5708f => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:48.869604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b990a7-279d-4551-b4c4-48d67cc6297f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:48.903458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:48.907871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a35898-812e-4436-b8f8-5b3792160e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:48.908878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a35898-812e-4436-b8f8-5b3792160e7a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:48.909289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a35898-812e-4436-b8f8-5b3792160e7a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:48.909667 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a35898-812e-4436-b8f8-5b3792160e7a None admin] PATH_INFO: `/v3/users/5b5c2d1ca27e412f8ab327a40ff52efa` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:48.911087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a35898-812e-4436-b8f8-5b3792160e7a None admin] RBAC: Authorizing `identity:get_user(user_id=5b5c2d1ca27e412f8ab327a40ff52efa)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:48.912685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a35898-812e-4436-b8f8-5b3792160e7a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:48.914459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 103/205] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:48 2022] GET /identity/v3/users/5b5c2d1ca27e412f8ab327a40ff52efa => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:48.920905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38351a46-6d94-45d8-bdee-cb53e8d30910 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:48.926163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:49.091418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38351a46-6d94-45d8-bdee-cb53e8d30910 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:49.148492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaf580-ddbf-4c09-a2d7-1653e7b53096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:49.149125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaf580-ddbf-4c09-a2d7-1653e7b53096 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:49.149446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaf580-ddbf-4c09-a2d7-1653e7b53096 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:49.149747 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafaf580-ddbf-4c09-a2d7-1653e7b53096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:49.254757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaf580-ddbf-4c09-a2d7-1653e7b53096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:49.256313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafaf580-ddbf-4c09-a2d7-1653e7b53096 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:49.258268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:49.376394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 103/206] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 13:38:49.381952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a35898-812e-4436-b8f8-5b3792160e7a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:49.533138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a35898-812e-4436-b8f8-5b3792160e7a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:49.592802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55326f-b591-44fa-a4ee-132e8b28d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:49.593677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55326f-b591-44fa-a4ee-132e8b28d859 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:49.593964 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55326f-b591-44fa-a4ee-132e8b28d859 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:49.594242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55326f-b591-44fa-a4ee-132e8b28d859 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:49.595480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55326f-b591-44fa-a4ee-132e8b28d859 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:49.596950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55326f-b591-44fa-a4ee-132e8b28d859 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:49.599047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 104/207] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:49 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:49.605790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaf580-ddbf-4c09-a2d7-1653e7b53096 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:49.780149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafaf580-ddbf-4c09-a2d7-1653e7b53096 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:49.781742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:49.833211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ee79f-e380-4269-ab33-f3f33a0c6ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:49.833892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ee79f-e380-4269-ab33-f3f33a0c6ade None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:49.834173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ee79f-e380-4269-ab33-f3f33a0c6ade None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:49.834449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ee79f-e380-4269-ab33-f3f33a0c6ade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:49.835310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ee79f-e380-4269-ab33-f3f33a0c6ade None admin] RBAC: Adding query filter params (role.id=bfe83dde5e854daeb7b29edf7171f8d7, scope.project.id=b3755fb9019c4a62a3376df0865a1020, user.id=5b5c2d1ca27e412f8ab327a40ff52efa) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:49.835622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ee79f-e380-4269-ab33-f3f33a0c6ade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:49.837058 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ee79f-e380-4269-ab33-f3f33a0c6ade None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:49.852576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 104/208] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:49 2022] GET /identity/v3/role_assignments?user.id=5b5c2d1ca27e412f8ab327a40ff52efa&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=bfe83dde5e854daeb7b29edf7171f8d7 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:50.611677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce1134-0a9e-4c8e-bd42-34bef46f1765 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:50.612222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce1134-0a9e-4c8e-bd42-34bef46f1765 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:50.612488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce1134-0a9e-4c8e-bd42-34bef46f1765 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:50.613743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 105/209] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:50.619442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a8a0b-08e5-4cec-abcc-bbfb5b61ad9f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:50.620306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a8a0b-08e5-4cec-abcc-bbfb5b61ad9f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:50.620761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a8a0b-08e5-4cec-abcc-bbfb5b61ad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:50.643367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-bf8a8a0b-08e5-4cec-abcc-bbfb5b61ad9f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:50.644571 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bf8a8a0b-08e5-4cec-abcc-bbfb5b61ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:50.732549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 105/210] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:50.748901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13d01-30dc-42eb-89a7-53f9fdd53c93 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:50.749189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13d01-30dc-42eb-89a7-53f9fdd53c93 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:50.749630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13d01-30dc-42eb-89a7-53f9fdd53c93 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:50.749741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa2951-7d3f-4ba9-9b5c-bf11c6b1b2b9 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:50.749996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa2951-7d3f-4ba9-9b5c-bf11c6b1b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:50.750283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa2951-7d3f-4ba9-9b5c-bf11c6b1b2b9 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:50.751589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 106/211] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:50.752777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 106/212] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:38:50.757614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7aba-b60d-40c8-b3ee-d2bc426085ad None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:50.757948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa2951-7d3f-4ba9-9b5c-bf11c6b1b2b9 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:50.758069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7aba-b60d-40c8-b3ee-d2bc426085ad None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:50.758250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7aba-b60d-40c8-b3ee-d2bc426085ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:50.775549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-254e7aba-b60d-40c8-b3ee-d2bc426085ad None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:50.776732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-254e7aba-b60d-40c8-b3ee-d2bc426085ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:50.834619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:50.849011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 107/213] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:50.850255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c654510-b262-41db-a418-4a99fe8e06ac None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:50.858317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c654510-b262-41db-a418-4a99fe8e06ac None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:50.858317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c654510-b262-41db-a418-4a99fe8e06ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:50.871776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-5c654510-b262-41db-a418-4a99fe8e06ac None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:50.872826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:50.874472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5c654510-b262-41db-a418-4a99fe8e06ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:50.879197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa2951-7d3f-4ba9-9b5c-bf11c6b1b2b9 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:50.915161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862260f9-0db5-49f9-96e7-7557acc25dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:50.915950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862260f9-0db5-49f9-96e7-7557acc25dbb None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:50.916227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862260f9-0db5-49f9-96e7-7557acc25dbb None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:50.916495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862260f9-0db5-49f9-96e7-7557acc25dbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:50.927849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862260f9-0db5-49f9-96e7-7557acc25dbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-862260f9-0db5-49f9-96e7-7557acc25dbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:50.936174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:50.937057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:50.937844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 107/214] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:38:50.938939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862260f9-0db5-49f9-96e7-7557acc25dbb None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:50.954587 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 108/215] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:50.959483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c654510-b262-41db-a418-4a99fe8e06ac None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:51.052267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862260f9-0db5-49f9-96e7-7557acc25dbb None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:51.063243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c654510-b262-41db-a418-4a99fe8e06ac None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:51.081671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:51.089832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc028fc9-42f7-479f-b625-323ea191cdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:51.093808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc028fc9-42f7-479f-b625-323ea191cdf8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.093808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc028fc9-42f7-479f-b625-323ea191cdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.093808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc028fc9-42f7-479f-b625-323ea191cdf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.099230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfeec2-0c3a-4aab-a409-c651ce990432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:51.099901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfeec2-0c3a-4aab-a409-c651ce990432 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.100189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfeec2-0c3a-4aab-a409-c651ce990432 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.100471 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfeec2-0c3a-4aab-a409-c651ce990432 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.101271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfeec2-0c3a-4aab-a409-c651ce990432 None admin] RBAC: Adding query filter params (name=member) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:51.101580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfeec2-0c3a-4aab-a409-c651ce990432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:51.102993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cfeec2-0c3a-4aab-a409-c651ce990432 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:51.103106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc028fc9-42f7-479f-b625-323ea191cdf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-cc028fc9-42f7-479f-b625-323ea191cdf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:51.110954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:51.111857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:51.113020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:51.113969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 109/216] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:51.114038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 108/217] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:38:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:51.117607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfeec2-0c3a-4aab-a409-c651ce990432 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:51.118154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc028fc9-42f7-479f-b625-323ea191cdf8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:51.139356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:51.229963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cfeec2-0c3a-4aab-a409-c651ce990432 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:51.234469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc028fc9-42f7-479f-b625-323ea191cdf8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:51.270244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d585f-c80b-40b2-9e66-f5a16c19a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:51.271074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d585f-c80b-40b2-9e66-f5a16c19a167 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.271269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52327-b990-4a9e-9f0f-eab66fd62cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:51.271378 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d585f-c80b-40b2-9e66-f5a16c19a167 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.271621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d585f-c80b-40b2-9e66-f5a16c19a167 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.272175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52327-b990-4a9e-9f0f-eab66fd62cb5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.272421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52327-b990-4a9e-9f0f-eab66fd62cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.272698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b52327-b990-4a9e-9f0f-eab66fd62cb5 None admin] PATH_INFO: `/v3/users/7534e9c09daf415285169f53d20696e5` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.272789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d585f-c80b-40b2-9e66-f5a16c19a167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:51.274250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d585f-c80b-40b2-9e66-f5a16c19a167 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:51.281189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 110/218] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:51.281189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d585f-c80b-40b2-9e66-f5a16c19a167 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:51.294754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b52327-b990-4a9e-9f0f-eab66fd62cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=7534e9c09daf415285169f53d20696e5)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:51.296759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b52327-b990-4a9e-9f0f-eab66fd62cb5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:51.298867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 109/219] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:51 2022] GET /identity/v3/users/7534e9c09daf415285169f53d20696e5 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:51.303750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52327-b990-4a9e-9f0f-eab66fd62cb5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:51.327985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:51.378694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d585f-c80b-40b2-9e66-f5a16c19a167 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:51.383320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:51.408762 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b52327-b990-4a9e-9f0f-eab66fd62cb5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:51.414088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce58223-fe0b-4485-89ea-3658c47bcf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:51.414764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58223-fe0b-4485-89ea-3658c47bcf0b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.415086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58223-fe0b-4485-89ea-3658c47bcf0b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.415367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce58223-fe0b-4485-89ea-3658c47bcf0b None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.416150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce58223-fe0b-4485-89ea-3658c47bcf0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:51.416461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce58223-fe0b-4485-89ea-3658c47bcf0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:51.417853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce58223-fe0b-4485-89ea-3658c47bcf0b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:51.426577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 111/220] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:51.427411 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce58223-fe0b-4485-89ea-3658c47bcf0b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:51.443882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83d3e1-292c-4b82-8d35-86ec4d45effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:51.444546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d3e1-292c-4b82-8d35-86ec4d45effb None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.444822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d3e1-292c-4b82-8d35-86ec4d45effb None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.445097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d3e1-292c-4b82-8d35-86ec4d45effb None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.445800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d3e1-292c-4b82-8d35-86ec4d45effb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:51.447266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d3e1-292c-4b82-8d35-86ec4d45effb None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:51.532378 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce58223-fe0b-4485-89ea-3658c47bcf0b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:51.536337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 110/221] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:38:51 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:38:51.537467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354102-9847-4aeb-a009-4b8731f5de35 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.537757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354102-9847-4aeb-a009-4b8731f5de35 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.538037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d354102-9847-4aeb-a009-4b8731f5de35 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.539331 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 111/222] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:51.540051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d354102-9847-4aeb-a009-4b8731f5de35 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:51.543414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:51.573110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b26e35-c582-483e-adc9-cdd25f8ef800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:51.574050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b26e35-c582-483e-adc9-cdd25f8ef800 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.574484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b26e35-c582-483e-adc9-cdd25f8ef800 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.574917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b26e35-c582-483e-adc9-cdd25f8ef800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.656935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d354102-9847-4aeb-a009-4b8731f5de35 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:51.663690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b26e35-c582-483e-adc9-cdd25f8ef800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:51.665745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b26e35-c582-483e-adc9-cdd25f8ef800 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:51.694013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:51.701554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b14516-fb4b-4848-8565-5369b90ba6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:51.702696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b14516-fb4b-4848-8565-5369b90ba6b7 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.703094 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b14516-fb4b-4848-8565-5369b90ba6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.703332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b14516-fb4b-4848-8565-5369b90ba6b7 None admin] PATH_INFO: `/v3/users/37556d4edbe24d7286181126851d570c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.711985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b14516-fb4b-4848-8565-5369b90ba6b7 None admin] RBAC: Authorizing `identity:get_user(user_id=37556d4edbe24d7286181126851d570c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:51.711985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b14516-fb4b-4848-8565-5369b90ba6b7 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:51.711985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 112/223] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:51 2022] GET /identity/v3/users/37556d4edbe24d7286181126851d570c => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:51.711985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570648d-ca25-4b7c-8951-a5414fdbdff1 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.711985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570648d-ca25-4b7c-8951-a5414fdbdff1 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.711985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570648d-ca25-4b7c-8951-a5414fdbdff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.727513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d570648d-ca25-4b7c-8951-a5414fdbdff1 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:51.728701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d570648d-ca25-4b7c-8951-a5414fdbdff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:51.794344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 112/224] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:51.796172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b26e35-c582-483e-adc9-cdd25f8ef800 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:51.806963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 113/225] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:51.806963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570648d-ca25-4b7c-8951-a5414fdbdff1 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:51.810587 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:51.929771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b26e35-c582-483e-adc9-cdd25f8ef800 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:51.936186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570648d-ca25-4b7c-8951-a5414fdbdff1 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:51.974763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e82d5a-c9b3-4bf1-ba28-13b87d1ce5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:51.975897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82d5a-c9b3-4bf1-ba28-13b87d1ce5c4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.976236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82d5a-c9b3-4bf1-ba28-13b87d1ce5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.976516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82d5a-c9b3-4bf1-ba28-13b87d1ce5c4 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.976616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:51.977737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e82d5a-c9b3-4bf1-ba28-13b87d1ce5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:51.979319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e82d5a-c9b3-4bf1-ba28-13b87d1ce5c4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:51.981925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 113/226] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:51 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:51.982724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e82d5a-c9b3-4bf1-ba28-13b87d1ce5c4 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:51.989834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415a9bc-e224-4e4e-b349-bd4d7fc1e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:51.990700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415a9bc-e224-4e4e-b349-bd4d7fc1e3a6 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:51.990993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415a9bc-e224-4e4e-b349-bd4d7fc1e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:51.991281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415a9bc-e224-4e4e-b349-bd4d7fc1e3a6 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:51.993073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415a9bc-e224-4e4e-b349-bd4d7fc1e3a6 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:51.995020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415a9bc-e224-4e4e-b349-bd4d7fc1e3a6 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:51.998421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 114/227] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:51 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:51.999274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415a9bc-e224-4e4e-b349-bd4d7fc1e3a6 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:52.081010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:52.104232 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e82d5a-c9b3-4bf1-ba28-13b87d1ce5c4 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:52.135854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415a9bc-e224-4e4e-b349-bd4d7fc1e3a6 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:52.147937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241eafe-b67f-4d07-8eac-acc12e8dadb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:52.148837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241eafe-b67f-4d07-8eac-acc12e8dadb5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:52.149186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241eafe-b67f-4d07-8eac-acc12e8dadb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:52.149530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241eafe-b67f-4d07-8eac-acc12e8dadb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:52.161131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241eafe-b67f-4d07-8eac-acc12e8dadb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-f241eafe-b67f-4d07-8eac-acc12e8dadb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:52.169458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:52.172872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 114/228] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:38:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:52.174899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241eafe-b67f-4d07-8eac-acc12e8dadb5 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:52.183929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60d04-c8bc-4b17-bd72-f11de71cee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:52.185677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60d04-c8bc-4b17-bd72-f11de71cee23 None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:52.185971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60d04-c8bc-4b17-bd72-f11de71cee23 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:52.186280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea60d04-c8bc-4b17-bd72-f11de71cee23 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/users/37556d4edbe24d7286181126851d570c/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:52.189097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea60d04-c8bc-4b17-bd72-f11de71cee23 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8cb39fe7bad426e9aac2872667c1a1c, user_id=37556d4edbe24d7286181126851d570c, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:52.191096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea60d04-c8bc-4b17-bd72-f11de71cee23 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:52.285051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241eafe-b67f-4d07-8eac-acc12e8dadb5 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:52.307356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 115/229] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:38:51 2022] PUT /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/users/37556d4edbe24d7286181126851d570c/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:38:52.309025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60d04-c8bc-4b17-bd72-f11de71cee23 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:52.342434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25484b1f-5280-4daa-9311-c4d5b77b1ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:52.343193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484b1f-5280-4daa-9311-c4d5b77b1ab8 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:52.343529 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484b1f-5280-4daa-9311-c4d5b77b1ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:52.343984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25484b1f-5280-4daa-9311-c4d5b77b1ab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:52.344726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25484b1f-5280-4daa-9311-c4d5b77b1ab8 None admin] RBAC: Adding query filter params (role.id=1067c35f1111496c983a6a7dec2a5ad9, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c, user.id=7534e9c09daf415285169f53d20696e5) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:52.345043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25484b1f-5280-4daa-9311-c4d5b77b1ab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:52.346654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25484b1f-5280-4daa-9311-c4d5b77b1ab8 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:52.361545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 115/230] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:52 2022] GET /identity/v3/role_assignments?user.id=7534e9c09daf415285169f53d20696e5&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:52.411514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:52.437803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea60d04-c8bc-4b17-bd72-f11de71cee23 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:52.480146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7e7bc-34df-4c93-a085-772b89f53d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:52.481174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7e7bc-34df-4c93-a085-772b89f53d3a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:52.482373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7e7bc-34df-4c93-a085-772b89f53d3a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:52.483054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7e7bc-34df-4c93-a085-772b89f53d3a None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:52.485704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7e7bc-34df-4c93-a085-772b89f53d3a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:52.485704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7e7bc-34df-4c93-a085-772b89f53d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:52.486312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7e7bc-34df-4c93-a085-772b89f53d3a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:52.496739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 116/231] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:38:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:52.504242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25484b1f-5280-4daa-9311-c4d5b77b1ab8 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:52.512602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:52.666019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25484b1f-5280-4daa-9311-c4d5b77b1ab8 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:52.710232 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb4e3b-ea6d-4d7e-89e9-02782dc782a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:52.711097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb4e3b-ea6d-4d7e-89e9-02782dc782a7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:52.711393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb4e3b-ea6d-4d7e-89e9-02782dc782a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:52.711677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb4e3b-ea6d-4d7e-89e9-02782dc782a7 None admin] PATH_INFO: `/v3/users/37556d4edbe24d7286181126851d570c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:52.712917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb4e3b-ea6d-4d7e-89e9-02782dc782a7 None admin] RBAC: Authorizing `identity:get_user(user_id=37556d4edbe24d7286181126851d570c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:52.714411 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb4e3b-ea6d-4d7e-89e9-02782dc782a7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:52.717272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 116/232] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:52 2022] GET /identity/v3/users/37556d4edbe24d7286181126851d570c => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:52.722403 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7e7bc-34df-4c93-a085-772b89f53d3a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:52.830648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7e7bc-34df-4c93-a085-772b89f53d3a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:52.848609 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:52.866479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864aa890-67f4-4dcb-a7d6-466c68a07a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:52.867381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa890-67f4-4dcb-a7d6-466c68a07a86 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:52.867668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa890-67f4-4dcb-a7d6-466c68a07a86 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:52.867949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864aa890-67f4-4dcb-a7d6-466c68a07a86 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:52.869157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa890-67f4-4dcb-a7d6-466c68a07a86 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:52.870608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864aa890-67f4-4dcb-a7d6-466c68a07a86 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:52.873283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 117/233] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:52 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:52.880352 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb4e3b-ea6d-4d7e-89e9-02782dc782a7 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:52.984031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:53.024623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb4e3b-ea6d-4d7e-89e9-02782dc782a7 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:53.066494 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0e0ea-aa0a-4e68-a1d6-1ae13812a6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:53.067866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0e0ea-aa0a-4e68-a1d6-1ae13812a6d4 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:53.068364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0e0ea-aa0a-4e68-a1d6-1ae13812a6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:53.068884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0e0ea-aa0a-4e68-a1d6-1ae13812a6d4 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/users/37556d4edbe24d7286181126851d570c/roles/a97f5aba7e1b4044b2c749cba5d5708f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:53.071385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0e0ea-aa0a-4e68-a1d6-1ae13812a6d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8cb39fe7bad426e9aac2872667c1a1c, user_id=37556d4edbe24d7286181126851d570c, role_id=a97f5aba7e1b4044b2c749cba5d5708f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:53.073048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0e0ea-aa0a-4e68-a1d6-1ae13812a6d4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:53.186147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 117/234] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:38:52 2022] PUT /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/users/37556d4edbe24d7286181126851d570c/roles/a97f5aba7e1b4044b2c749cba5d5708f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:38:54.212225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab3e68-5436-4d7c-b00a-0eec30768beb None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:54.213243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab3e68-5436-4d7c-b00a-0eec30768beb None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:54.213727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab3e68-5436-4d7c-b00a-0eec30768beb None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:54.215351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 118/235] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:54.218704 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79c536-1b1e-49da-a657-dd601eafeda2 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:54.219539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79c536-1b1e-49da-a657-dd601eafeda2 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:54.220025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79c536-1b1e-49da-a657-dd601eafeda2 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:54.221276 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2528ff-f9a5-4a41-aad9-310a9a22152e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:54.221624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 118/236] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:54.222039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2528ff-f9a5-4a41-aad9-310a9a22152e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:54.222481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2528ff-f9a5-4a41-aad9-310a9a22152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:54.226827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf499e2-9d6f-4e72-9784-f41b07b2340a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:54.227148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf499e2-9d6f-4e72-9784-f41b07b2340a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:54.227429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf499e2-9d6f-4e72-9784-f41b07b2340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:54.241738 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7b2528ff-f9a5-4a41-aad9-310a9a22152e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:54.243242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7b2528ff-f9a5-4a41-aad9-310a9a22152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:54.255943 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fbf499e2-9d6f-4e72-9784-f41b07b2340a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:54.257142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fbf499e2-9d6f-4e72-9784-f41b07b2340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:54.322053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 119/237] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:54.360817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 119/238] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:54.362616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2528ff-f9a5-4a41-aad9-310a9a22152e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:54.386562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf499e2-9d6f-4e72-9784-f41b07b2340a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:54.479334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:54.519264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf499e2-9d6f-4e72-9784-f41b07b2340a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:54.526622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2528ff-f9a5-4a41-aad9-310a9a22152e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:54.555398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:54.555918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48994d56-3c37-400c-96d9-38fb9a9f5403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:54.557077 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48994d56-3c37-400c-96d9-38fb9a9f5403 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:54.557516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48994d56-3c37-400c-96d9-38fb9a9f5403 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:54.557949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48994d56-3c37-400c-96d9-38fb9a9f5403 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:54.559319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48994d56-3c37-400c-96d9-38fb9a9f5403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:54.561030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48994d56-3c37-400c-96d9-38fb9a9f5403 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:54.563286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 120/239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:54.567580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236a541-0893-4841-8806-4971f0f8cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:54.568560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236a541-0893-4841-8806-4971f0f8cd03 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:54.569016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236a541-0893-4841-8806-4971f0f8cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:54.569472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a236a541-0893-4841-8806-4971f0f8cd03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:54.571878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48994d56-3c37-400c-96d9-38fb9a9f5403 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:54.596797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a236a541-0893-4841-8806-4971f0f8cd03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-a236a541-0893-4841-8806-4971f0f8cd03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:54.613056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:54.614189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:38:54.615192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:54.617170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 120/240] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:54.624134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236a541-0893-4841-8806-4971f0f8cd03 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:54.765454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48994d56-3c37-400c-96d9-38fb9a9f5403 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:54.823360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:54.829909 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a236a541-0893-4841-8806-4971f0f8cd03 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:54.844698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f956a-fd24-44fa-a5ea-49a9ecaed4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:54.845397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f956a-fd24-44fa-a5ea-49a9ecaed4e3 None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:54.845684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f956a-fd24-44fa-a5ea-49a9ecaed4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:54.845963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f956a-fd24-44fa-a5ea-49a9ecaed4e3 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:54.846718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f956a-fd24-44fa-a5ea-49a9ecaed4e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:54.848221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f956a-fd24-44fa-a5ea-49a9ecaed4e3 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:54.894625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab586a4-9656-4ec1-b0c2-6546fca7e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:54.899489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab586a4-9656-4ec1-b0c2-6546fca7e810 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:54.899489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab586a4-9656-4ec1-b0c2-6546fca7e810 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:54.899489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab586a4-9656-4ec1-b0c2-6546fca7e810 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:54.899489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab586a4-9656-4ec1-b0c2-6546fca7e810 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:54.899489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab586a4-9656-4ec1-b0c2-6546fca7e810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:54.899489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab586a4-9656-4ec1-b0c2-6546fca7e810 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:54.908252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 121/241] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:54.913772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab586a4-9656-4ec1-b0c2-6546fca7e810 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:54.960489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 121/242] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:38:54 2022] POST /identity/v3/users => generated 293 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:38:54.964627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:55.037984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab586a4-9656-4ec1-b0c2-6546fca7e810 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:55.077170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af2be-b882-458b-a0df-df60c474046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:55.078139 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af2be-b882-458b-a0df-df60c474046c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:55.078427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af2be-b882-458b-a0df-df60c474046c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:55.078708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af2be-b882-458b-a0df-df60c474046c None admin] PATH_INFO: `/v3/users/69fecc54ad044bcabf5e0c4596312653` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:55.094903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055af2be-b882-458b-a0df-df60c474046c None admin] RBAC: Authorizing `identity:get_user(user_id=69fecc54ad044bcabf5e0c4596312653)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:55.096493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055af2be-b882-458b-a0df-df60c474046c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:55.098511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 122/243] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:54 2022] GET /identity/v3/users/69fecc54ad044bcabf5e0c4596312653 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:55.104142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f956a-fd24-44fa-a5ea-49a9ecaed4e3 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:55.230230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f956a-fd24-44fa-a5ea-49a9ecaed4e3 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:55.263747 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638aa91-c3ad-479b-88dd-f60bf424d0ea None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:55.264275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638aa91-c3ad-479b-88dd-f60bf424d0ea None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:55.264275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638aa91-c3ad-479b-88dd-f60bf424d0ea None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:55.265726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 123/244] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:38:55.275677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e3398-941a-45a1-b146-77d0b8e06ea9 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:55.275959 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e3398-941a-45a1-b146-77d0b8e06ea9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:55.276236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e3398-941a-45a1-b146-77d0b8e06ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:55.296463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-424e3398-941a-45a1-b146-77d0b8e06ea9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:55.296631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228f941-8a70-45cb-9b9f-ce903b3d7fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:55.296895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f941-8a70-45cb-9b9f-ce903b3d7fa8 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:55.297202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f941-8a70-45cb-9b9f-ce903b3d7fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:55.297733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228f941-8a70-45cb-9b9f-ce903b3d7fa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:55.298949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-424e3398-941a-45a1-b146-77d0b8e06ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:55.359776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:55.375679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228f941-8a70-45cb-9b9f-ce903b3d7fa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:55.377347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228f941-8a70-45cb-9b9f-ce903b3d7fa8 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:55.378348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 124/245] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:55.405412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e3398-941a-45a1-b146-77d0b8e06ea9 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:55.443315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:55.502093 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 122/246] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:55.503302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663d665-2ef1-4f7c-8560-40f952448c90 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:55.503593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663d665-2ef1-4f7c-8560-40f952448c90 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:55.503874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663d665-2ef1-4f7c-8560-40f952448c90 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:55.505315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 123/247] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:55.513407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f220ec-ff62-4dbf-b2c5-e799d96742db None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:55.513710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f220ec-ff62-4dbf-b2c5-e799d96742db None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:55.513951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f220ec-ff62-4dbf-b2c5-e799d96742db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:55.535314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-28f220ec-ff62-4dbf-b2c5-e799d96742db None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:55.537119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-28f220ec-ff62-4dbf-b2c5-e799d96742db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:55.549449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e3398-941a-45a1-b146-77d0b8e06ea9 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:55.594508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5259aa2-5fe7-41ee-a77f-110ea7ebe5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:55.595821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5259aa2-5fe7-41ee-a77f-110ea7ebe5d8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:55.596301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5259aa2-5fe7-41ee-a77f-110ea7ebe5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:55.596872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5259aa2-5fe7-41ee-a77f-110ea7ebe5d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:55.612224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5259aa2-5fe7-41ee-a77f-110ea7ebe5d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:55.618990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 124/248] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:55.618990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f220ec-ff62-4dbf-b2c5-e799d96742db None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-d5259aa2-5fe7-41ee-a77f-110ea7ebe5d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:55.621754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:55.623447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:38:55.624612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 125/249] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:55.633268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5259aa2-5fe7-41ee-a77f-110ea7ebe5d8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:55.642137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:55.740998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f220ec-ff62-4dbf-b2c5-e799d96742db None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:55.759910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:55.773866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5259aa2-5fe7-41ee-a77f-110ea7ebe5d8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:55.780639 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677aee-68c8-44d2-9a76-00da6b39347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:55.782387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677aee-68c8-44d2-9a76-00da6b39347e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:55.783464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677aee-68c8-44d2-9a76-00da6b39347e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:55.784190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677aee-68c8-44d2-9a76-00da6b39347e None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:55.785804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a677aee-68c8-44d2-9a76-00da6b39347e None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:55.787563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a677aee-68c8-44d2-9a76-00da6b39347e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:55.789577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 125/250] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:55 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:55.790636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677aee-68c8-44d2-9a76-00da6b39347e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:55.814839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06912282-22bd-4204-adfb-67385f8c409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:55.815479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06912282-22bd-4204-adfb-67385f8c409e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:55.815768 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06912282-22bd-4204-adfb-67385f8c409e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:55.816045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06912282-22bd-4204-adfb-67385f8c409e None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:55.816801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06912282-22bd-4204-adfb-67385f8c409e None admin] RBAC: Adding query filter params (name=member) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:55.817107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06912282-22bd-4204-adfb-67385f8c409e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:55.818682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06912282-22bd-4204-adfb-67385f8c409e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:55.828945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 126/251] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:55.837127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06912282-22bd-4204-adfb-67385f8c409e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:55.888381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:55.907594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677aee-68c8-44d2-9a76-00da6b39347e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:55.944410 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbde25d-58e1-4e08-be5f-0892bcf131ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:55.945604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde25d-58e1-4e08-be5f-0892bcf131ae None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:55.946080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde25d-58e1-4e08-be5f-0892bcf131ae None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:55.946541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbde25d-58e1-4e08-be5f-0892bcf131ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:55.951240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06912282-22bd-4204-adfb-67385f8c409e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:55.959219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbde25d-58e1-4e08-be5f-0892bcf131ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-1bbde25d-58e1-4e08-be5f-0892bcf131ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:55.967703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:55.968576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:38:55.969392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:55.969975 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 126/252] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:38:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:55.970545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbde25d-58e1-4e08-be5f-0892bcf131ae None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:56.000804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f011d-3b3a-46f2-8918-29adb943b458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:56.001471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f011d-3b3a-46f2-8918-29adb943b458 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:56.001754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f011d-3b3a-46f2-8918-29adb943b458 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:56.002032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f011d-3b3a-46f2-8918-29adb943b458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:56.002984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f011d-3b3a-46f2-8918-29adb943b458 None admin] RBAC: Adding query filter params (role.id=bfe83dde5e854daeb7b29edf7171f8d7, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c, user.id=69fecc54ad044bcabf5e0c4596312653) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:56.003406 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f011d-3b3a-46f2-8918-29adb943b458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:56.004836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f011d-3b3a-46f2-8918-29adb943b458 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:56.010744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 127/253] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:55 2022] GET /identity/v3/role_assignments?user.id=69fecc54ad044bcabf5e0c4596312653&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=bfe83dde5e854daeb7b29edf7171f8d7 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:56.011616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f011d-3b3a-46f2-8918-29adb943b458 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:56.047638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:56.126309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f011d-3b3a-46f2-8918-29adb943b458 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:56.134627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbde25d-58e1-4e08-be5f-0892bcf131ae None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:56.166984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a83c-57cc-4dae-a707-f28408071fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:56.167675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a83c-57cc-4dae-a707-f28408071fa8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:56.167961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a83c-57cc-4dae-a707-f28408071fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:56.168238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a83c-57cc-4dae-a707-f28408071fa8 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:56.172784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a83c-57cc-4dae-a707-f28408071fa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:56.172784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a83c-57cc-4dae-a707-f28408071fa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:56.172784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a83c-57cc-4dae-a707-f28408071fa8 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:56.181022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 128/254] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:56.187367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a83c-57cc-4dae-a707-f28408071fa8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:56.207826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993ae43-299c-463e-bf2d-b11e58c6b489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:56.208734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993ae43-299c-463e-bf2d-b11e58c6b489 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:56.209020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993ae43-299c-463e-bf2d-b11e58c6b489 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:56.209294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993ae43-299c-463e-bf2d-b11e58c6b489 None admin] PATH_INFO: `/v3/users/7534e9c09daf415285169f53d20696e5` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:56.210836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993ae43-299c-463e-bf2d-b11e58c6b489 None admin] RBAC: Authorizing `identity:get_user(user_id=7534e9c09daf415285169f53d20696e5)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:56.212342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993ae43-299c-463e-bf2d-b11e58c6b489 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:56.214270 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 127/255] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:55 2022] GET /identity/v3/users/7534e9c09daf415285169f53d20696e5 => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:56.228043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993ae43-299c-463e-bf2d-b11e58c6b489 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:56.247569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:56.310458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:56.345029 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993ae43-299c-463e-bf2d-b11e58c6b489 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:56.366313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a83c-57cc-4dae-a707-f28408071fa8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:56.381294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08792fd2-3317-432d-b621-28e6f486f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:56.382070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08792fd2-3317-432d-b621-28e6f486f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:56.382354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08792fd2-3317-432d-b621-28e6f486f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:56.382626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08792fd2-3317-432d-b621-28e6f486f0a4 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:56.391969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08792fd2-3317-432d-b621-28e6f486f0a4 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:56.393481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08792fd2-3317-432d-b621-28e6f486f0a4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:56.395669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 128/256] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:56 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:56.400659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f4935-9cea-486b-a19f-9ef499986008 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:56.400941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f4935-9cea-486b-a19f-9ef499986008 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:56.401267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f4935-9cea-486b-a19f-9ef499986008 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:56.403069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 129/257] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:56.405161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f4935-9cea-486b-a19f-9ef499986008 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:56.428073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fec3b-374d-4a6b-baaa-a0dce541f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:56.429448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fec3b-374d-4a6b-baaa-a0dce541f356 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:56.430062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fec3b-374d-4a6b-baaa-a0dce541f356 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:56.430537 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fec3b-374d-4a6b-baaa-a0dce541f356 None admin] PATH_INFO: `/v3/users/37556d4edbe24d7286181126851d570c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:56.432527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fec3b-374d-4a6b-baaa-a0dce541f356 None admin] RBAC: Authorizing `identity:get_user(user_id=37556d4edbe24d7286181126851d570c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:56.434443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fec3b-374d-4a6b-baaa-a0dce541f356 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:56.436873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 129/258] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:56 2022] GET /identity/v3/users/37556d4edbe24d7286181126851d570c => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:56.438388 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80435a-7bb1-4c24-b657-7cb5d7eabf14 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:56.438883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80435a-7bb1-4c24-b657-7cb5d7eabf14 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:56.439472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80435a-7bb1-4c24-b657-7cb5d7eabf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:56.462547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-dc80435a-7bb1-4c24-b657-7cb5d7eabf14 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:56.464103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-dc80435a-7bb1-4c24-b657-7cb5d7eabf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:56.537124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 130/259] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:56.538303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80435a-7bb1-4c24-b657-7cb5d7eabf14 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:56.551347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:56.596497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f4935-9cea-486b-a19f-9ef499986008 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:56.636468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:56.679493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80435a-7bb1-4c24-b657-7cb5d7eabf14 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:56.683200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db22db-34b5-4001-a163-708d3c066b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:56.684155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db22db-34b5-4001-a163-708d3c066b60 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:56.685041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db22db-34b5-4001-a163-708d3c066b60 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:56.685449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db22db-34b5-4001-a163-708d3c066b60 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/users/7534e9c09daf415285169f53d20696e5/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:56.692318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db22db-34b5-4001-a163-708d3c066b60 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8cb39fe7bad426e9aac2872667c1a1c, user_id=7534e9c09daf415285169f53d20696e5, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:56.693800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db22db-34b5-4001-a163-708d3c066b60 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:56.718335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23046ca7-26cb-419c-be06-1de2e71699b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:56.719378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046ca7-26cb-419c-be06-1de2e71699b2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:56.719880 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046ca7-26cb-419c-be06-1de2e71699b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:56.720372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046ca7-26cb-419c-be06-1de2e71699b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:56.792675 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 130/260] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:38:56 2022] PUT /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/users/7534e9c09daf415285169f53d20696e5/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:38:56.793169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23046ca7-26cb-419c-be06-1de2e71699b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:56.793520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db22db-34b5-4001-a163-708d3c066b60 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:56.795925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23046ca7-26cb-419c-be06-1de2e71699b2 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:56.875432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:56.922381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 131/261] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:56.928794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23046ca7-26cb-419c-be06-1de2e71699b2 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:57.007385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db22db-34b5-4001-a163-708d3c066b60 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:57.039412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23046ca7-26cb-419c-be06-1de2e71699b2 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:57.078480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31fc23-1b1c-45d1-862e-52e31d852181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:57.079761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31fc23-1b1c-45d1-862e-52e31d852181 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:57.080246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31fc23-1b1c-45d1-862e-52e31d852181 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:57.080720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31fc23-1b1c-45d1-862e-52e31d852181 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:57.082280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31fc23-1b1c-45d1-862e-52e31d852181 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:57.083811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b9f2c-cdae-44a3-ba7d-173bd0da6cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:57.084309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31fc23-1b1c-45d1-862e-52e31d852181 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:57.084652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b9f2c-cdae-44a3-ba7d-173bd0da6cf4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:57.084945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b9f2c-cdae-44a3-ba7d-173bd0da6cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:57.085220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b9f2c-cdae-44a3-ba7d-173bd0da6cf4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:57.087084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 132/262] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:56 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:57.093910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31fc23-1b1c-45d1-862e-52e31d852181 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:57.108516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:57.115768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b9f2c-cdae-44a3-ba7d-173bd0da6cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-469b9f2c-cdae-44a3-ba7d-173bd0da6cf4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:57.130984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:57.131928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:57.133111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 131/263] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:57.139945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b9f2c-cdae-44a3-ba7d-173bd0da6cf4 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:57.151488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:57.239405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31fc23-1b1c-45d1-862e-52e31d852181 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:57.296888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f56fb-ac00-4768-8491-bf461e34d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:57.298229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f56fb-ac00-4768-8491-bf461e34d472 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:57.298712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f56fb-ac00-4768-8491-bf461e34d472 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:57.299215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f56fb-ac00-4768-8491-bf461e34d472 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:57.300312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f56fb-ac00-4768-8491-bf461e34d472 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c, user.id=37556d4edbe24d7286181126851d570c) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:57.300826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f56fb-ac00-4768-8491-bf461e34d472 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:57.302563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f56fb-ac00-4768-8491-bf461e34d472 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:57.310063 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 133/264] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:57 2022] GET /identity/v3/role_assignments?user.id=37556d4edbe24d7286181126851d570c&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=3951cc86a51d416fafc5676d456e79ce => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:57.347533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b9f2c-cdae-44a3-ba7d-173bd0da6cf4 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:57.411092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e79a7-cba0-44bd-9b84-6a7b70792453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:57.412140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e79a7-cba0-44bd-9b84-6a7b70792453 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:57.412625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e79a7-cba0-44bd-9b84-6a7b70792453 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:57.413098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e79a7-cba0-44bd-9b84-6a7b70792453 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:57.414066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e79a7-cba0-44bd-9b84-6a7b70792453 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:57.414571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e79a7-cba0-44bd-9b84-6a7b70792453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:57.416283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8e79a7-cba0-44bd-9b84-6a7b70792453 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:57.431531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 132/265] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:38:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:57.437895 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f56fb-ac00-4768-8491-bf461e34d472 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:57.565436 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f56fb-ac00-4768-8491-bf461e34d472 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:57.568733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:57.603944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762ffc1-f6f9-402d-803d-1f29a4aca395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:57.605223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ffc1-f6f9-402d-803d-1f29a4aca395 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:57.605767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ffc1-f6f9-402d-803d-1f29a4aca395 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:57.606897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762ffc1-f6f9-402d-803d-1f29a4aca395 None admin] PATH_INFO: `/v3/users/37556d4edbe24d7286181126851d570c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:57.608637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762ffc1-f6f9-402d-803d-1f29a4aca395 None admin] RBAC: Authorizing `identity:get_user(user_id=37556d4edbe24d7286181126851d570c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:57.610295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762ffc1-f6f9-402d-803d-1f29a4aca395 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:57.615314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 134/266] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:57 2022] GET /identity/v3/users/37556d4edbe24d7286181126851d570c => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:57.617882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e79a7-cba0-44bd-9b84-6a7b70792453 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:57.707143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:57.759940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8e79a7-cba0-44bd-9b84-6a7b70792453 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:57.808462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c5bf9-7529-4681-99e5-cb1894c04a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:57.809580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c5bf9-7529-4681-99e5-cb1894c04a92 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:57.810219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c5bf9-7529-4681-99e5-cb1894c04a92 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:57.810780 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c5bf9-7529-4681-99e5-cb1894c04a92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:57.902849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c5bf9-7529-4681-99e5-cb1894c04a92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:57.904742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c5bf9-7529-4681-99e5-cb1894c04a92 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:57.988565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:58.042784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 133/267] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:38:58.049840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762ffc1-f6f9-402d-803d-1f29a4aca395 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:58.185111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762ffc1-f6f9-402d-803d-1f29a4aca395 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:58.218070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0f1ba-a3e0-4eca-a474-a6012c52be1f None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:58.218070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0f1ba-a3e0-4eca-a474-a6012c52be1f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:58.218070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0f1ba-a3e0-4eca-a474-a6012c52be1f None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:58.218070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 134/268] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:38:58.222958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe4b2-c13e-40f7-ac94-ccdc49118380 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:58.223202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe4b2-c13e-40f7-ac94-ccdc49118380 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:58.223477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe4b2-c13e-40f7-ac94-ccdc49118380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:58.238703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db412c13-63c1-4d88-b4ed-d56c49433445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:58.240003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db412c13-63c1-4d88-b4ed-d56c49433445 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:58.240432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db412c13-63c1-4d88-b4ed-d56c49433445 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:58.240865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db412c13-63c1-4d88-b4ed-d56c49433445 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:58.242378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db412c13-63c1-4d88-b4ed-d56c49433445 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:58.242515 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a3fbe4b2-c13e-40f7-ac94-ccdc49118380 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:58.243720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a3fbe4b2-c13e-40f7-ac94-ccdc49118380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:58.244442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db412c13-63c1-4d88-b4ed-d56c49433445 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:58.246423 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 135/269] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:58 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:58.253189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db412c13-63c1-4d88-b4ed-d56c49433445 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:58.319363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:58.328742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 135/270] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:38:58.351541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbe4b2-c13e-40f7-ac94-ccdc49118380 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:58.431093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db412c13-63c1-4d88-b4ed-d56c49433445 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:58.445347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:58.459883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbe4b2-c13e-40f7-ac94-ccdc49118380 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:58.472962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96cf83-858c-4e43-953f-0d879d49439e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:58.473650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96cf83-858c-4e43-953f-0d879d49439e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:58.473900 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96cf83-858c-4e43-953f-0d879d49439e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:58.474172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96cf83-858c-4e43-953f-0d879d49439e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:58.475024 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96cf83-858c-4e43-953f-0d879d49439e None admin] RBAC: Adding query filter params (role.id=a97f5aba7e1b4044b2c749cba5d5708f, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c, user.id=37556d4edbe24d7286181126851d570c) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:58.475335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96cf83-858c-4e43-953f-0d879d49439e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:58.476777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96cf83-858c-4e43-953f-0d879d49439e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:58.484510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 136/271] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:38:58 2022] GET /identity/v3/role_assignments?user.id=37556d4edbe24d7286181126851d570c&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=a97f5aba7e1b4044b2c749cba5d5708f => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:58.485864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056452-3993-4d1d-81e4-6342fc85df68 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:58.486151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056452-3993-4d1d-81e4-6342fc85df68 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:58.486427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056452-3993-4d1d-81e4-6342fc85df68 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:58.487953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 137/272] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:58.496604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc6e99-a8a4-49b1-aca0-6b1c57c6e74e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:58.496959 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc6e99-a8a4-49b1-aca0-6b1c57c6e74e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:58.497373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc6e99-a8a4-49b1-aca0-6b1c57c6e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:58.526455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00218b66-1ce3-4334-8cab-dca9fa7ff14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:58.527380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00218b66-1ce3-4334-8cab-dca9fa7ff14e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:58.527666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00218b66-1ce3-4334-8cab-dca9fa7ff14e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:58.527938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00218b66-1ce3-4334-8cab-dca9fa7ff14e None admin] PATH_INFO: `/v3/roles/member` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:58.536394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d9cc6e99-a8a4-49b1-aca0-6b1c57c6e74e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:58.539999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d9cc6e99-a8a4-49b1-aca0-6b1c57c6e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:58.551255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00218b66-1ce3-4334-8cab-dca9fa7ff14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-00218b66-1ce3-4334-8cab-dca9fa7ff14e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:58.561310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:58.562319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:58.563168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 136/273] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:38:58.569126 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00218b66-1ce3-4334-8cab-dca9fa7ff14e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:58.690002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 138/274] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:58.721152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc6e99-a8a4-49b1-aca0-6b1c57c6e74e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:58.760109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00218b66-1ce3-4334-8cab-dca9fa7ff14e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:58.761780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:58.799365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fae80d-9aab-4143-b1da-098c2add3847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:58.800032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fae80d-9aab-4143-b1da-098c2add3847 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:58.800310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fae80d-9aab-4143-b1da-098c2add3847 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:58.800581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fae80d-9aab-4143-b1da-098c2add3847 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:58.801329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fae80d-9aab-4143-b1da-098c2add3847 None admin] RBAC: Adding query filter params (name=member) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:58.801629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fae80d-9aab-4143-b1da-098c2add3847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:58.803050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fae80d-9aab-4143-b1da-098c2add3847 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:58.814062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 137/275] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:58.820278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fae80d-9aab-4143-b1da-098c2add3847 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:58.835690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc6e99-a8a4-49b1-aca0-6b1c57c6e74e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:58.836407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:58.876213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedbd4a-38c2-4027-8152-fa80bb8de109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:58.877036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedbd4a-38c2-4027-8152-fa80bb8de109 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:58.877322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedbd4a-38c2-4027-8152-fa80bb8de109 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:58.877601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedbd4a-38c2-4027-8152-fa80bb8de109 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:58.878926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedbd4a-38c2-4027-8152-fa80bb8de109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:58.880490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedbd4a-38c2-4027-8152-fa80bb8de109 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:58.882685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 139/276] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:38:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:58.889039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedbd4a-38c2-4027-8152-fa80bb8de109 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:58.932888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fae80d-9aab-4143-b1da-098c2add3847 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:58.978524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2215a-6743-4603-b3b5-81e283ce2f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:58.979392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2215a-6743-4603-b3b5-81e283ce2f2d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:58.979672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2215a-6743-4603-b3b5-81e283ce2f2d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:58.979944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2215a-6743-4603-b3b5-81e283ce2f2d None admin] PATH_INFO: `/v3/users/e7be7d2132ce441b8e7518a9f5d657cd` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:59.001543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedbd4a-38c2-4027-8152-fa80bb8de109 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:59.003167 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:59.007213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2215a-6743-4603-b3b5-81e283ce2f2d None admin] RBAC: Authorizing `identity:get_user(user_id=e7be7d2132ce441b8e7518a9f5d657cd)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:59.009177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2215a-6743-4603-b3b5-81e283ce2f2d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:59.011207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 138/277] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:58 2022] GET /identity/v3/users/e7be7d2132ce441b8e7518a9f5d657cd => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:59.017884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2215a-6743-4603-b3b5-81e283ce2f2d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:59.040746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd02b4-43fd-4818-a8b0-00f3c775e5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:59.041806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd02b4-43fd-4818-a8b0-00f3c775e5d0 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:59.042467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd02b4-43fd-4818-a8b0-00f3c775e5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:59.043090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd02b4-43fd-4818-a8b0-00f3c775e5d0 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:59.044326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd02b4-43fd-4818-a8b0-00f3c775e5d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:59.045920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd02b4-43fd-4818-a8b0-00f3c775e5d0 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:59.098244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:59.128973 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2215a-6743-4603-b3b5-81e283ce2f2d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:59.147969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 140/278] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:38:58 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:38:59.149670 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d11b6-3c6d-4c53-bab6-ad602ca69fbb None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:59.150209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d11b6-3c6d-4c53-bab6-ad602ca69fbb None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:59.150552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d11b6-3c6d-4c53-bab6-ad602ca69fbb None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:59.152245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 141/279] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:38:59.158821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13a79-7ea9-4d3e-844d-4d399e534d2e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:59.159243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13a79-7ea9-4d3e-844d-4d399e534d2e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:59.159621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec13a79-7ea9-4d3e-844d-4d399e534d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:59.177741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e215a-2b6b-4642-8aba-f2f873f6e191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:59.178546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e215a-2b6b-4642-8aba-f2f873f6e191 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:59.178929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e215a-2b6b-4642-8aba-f2f873f6e191 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:59.179319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e215a-2b6b-4642-8aba-f2f873f6e191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:59.180265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e215a-2b6b-4642-8aba-f2f873f6e191 None admin] RBAC: Adding query filter params (role.id=1067c35f1111496c983a6a7dec2a5ad9, user.id=e7be7d2132ce441b8e7518a9f5d657cd, scope.system=all) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:59.180706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e215a-2b6b-4642-8aba-f2f873f6e191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:59.181588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7ec13a79-7ea9-4d3e-844d-4d399e534d2e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:38:59.182295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e215a-2b6b-4642-8aba-f2f873f6e191 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:59.184462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7ec13a79-7ea9-4d3e-844d-4d399e534d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:38:59.194095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 139/280] 10.222.0.42 () {56 vars in 1308 bytes} [Fri May 27 13:38:59 2022] GET /identity/v3/role_assignments?user.id=e7be7d2132ce441b8e7518a9f5d657cd&scope.system=all&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:38:59.275268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 142/281] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:38:59.291891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e215a-2b6b-4642-8aba-f2f873f6e191 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:59.411724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e215a-2b6b-4642-8aba-f2f873f6e191 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:59.454765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab916e7c-3634-4290-a9b5-58ccfb0c58af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:59.455602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab916e7c-3634-4290-a9b5-58ccfb0c58af None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:59.455884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab916e7c-3634-4290-a9b5-58ccfb0c58af None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:59.456155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab916e7c-3634-4290-a9b5-58ccfb0c58af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:59.458328 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:59.467502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab916e7c-3634-4290-a9b5-58ccfb0c58af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-ab916e7c-3634-4290-a9b5-58ccfb0c58af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:38:59.475110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:38:59.475959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:38:59.476737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 140/282] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:38:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:38:59.483279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13a79-7ea9-4d3e-844d-4d399e534d2e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:59.587963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:38:59.600836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec13a79-7ea9-4d3e-844d-4d399e534d2e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:59.642881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5cd9-1185-4cba-95c3-cd88cdc5511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:59.643593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5cd9-1185-4cba-95c3-cd88cdc5511e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:59.643878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5cd9-1185-4cba-95c3-cd88cdc5511e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:59.644146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5cd9-1185-4cba-95c3-cd88cdc5511e None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:59.648132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd5cd9-1185-4cba-95c3-cd88cdc5511e None admin] RBAC: Adding query filter params (name=reader) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:38:59.648132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd5cd9-1185-4cba-95c3-cd88cdc5511e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:59.648132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd5cd9-1185-4cba-95c3-cd88cdc5511e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:59.660385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 143/283] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:38:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:59.665970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab916e7c-3634-4290-a9b5-58ccfb0c58af None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:59.775295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab916e7c-3634-4290-a9b5-58ccfb0c58af None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:38:59.821024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46935c42-de80-4c12-86f9-3b3875a5c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:38:59.821899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46935c42-de80-4c12-86f9-3b3875a5c464 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:38:59.822191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46935c42-de80-4c12-86f9-3b3875a5c464 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:38:59.822464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46935c42-de80-4c12-86f9-3b3875a5c464 None admin] PATH_INFO: `/v3/users/69fecc54ad044bcabf5e0c4596312653` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:38:59.823691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46935c42-de80-4c12-86f9-3b3875a5c464 None admin] RBAC: Authorizing `identity:get_user(user_id=69fecc54ad044bcabf5e0c4596312653)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:38:59.825325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46935c42-de80-4c12-86f9-3b3875a5c464 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:38:59.826987 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 141/284] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:38:59 2022] GET /identity/v3/users/69fecc54ad044bcabf5e0c4596312653 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:38:59.832610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5cd9-1185-4cba-95c3-cd88cdc5511e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:38:59.963274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5cd9-1185-4cba-95c3-cd88cdc5511e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:00.017010 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdd326-e70c-462a-bb6f-91823598d004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:00.017878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd326-e70c-462a-bb6f-91823598d004 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:00.018158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd326-e70c-462a-bb6f-91823598d004 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:00.018432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdd326-e70c-462a-bb6f-91823598d004 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:00.019643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdd326-e70c-462a-bb6f-91823598d004 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:00.021095 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcdd326-e70c-462a-bb6f-91823598d004 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:00.022797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 144/285] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:38:59 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:00.029171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46935c42-de80-4c12-86f9-3b3875a5c464 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:00.094243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:00.149886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46935c42-de80-4c12-86f9-3b3875a5c464 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:00.178643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37022475-fc35-48d6-9ddc-478194dd954a None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:00.178934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37022475-fc35-48d6-9ddc-478194dd954a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:00.179233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37022475-fc35-48d6-9ddc-478194dd954a None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:00.180767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 145/286] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:00.186391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bae351-276b-45d1-96cc-acd0303ad0f3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:00.186674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bae351-276b-45d1-96cc-acd0303ad0f3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:00.186948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bae351-276b-45d1-96cc-acd0303ad0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:00.189824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fbd0a-cf4f-4c83-93c6-e0c7aa90ddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:00.190999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fbd0a-cf4f-4c83-93c6-e0c7aa90ddc8 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:00.191506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fbd0a-cf4f-4c83-93c6-e0c7aa90ddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:00.192003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fbd0a-cf4f-4c83-93c6-e0c7aa90ddc8 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/users/69fecc54ad044bcabf5e0c4596312653/roles/bfe83dde5e854daeb7b29edf7171f8d7` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:00.194564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fbd0a-cf4f-4c83-93c6-e0c7aa90ddc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8cb39fe7bad426e9aac2872667c1a1c, user_id=69fecc54ad044bcabf5e0c4596312653, role_id=bfe83dde5e854daeb7b29edf7171f8d7)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:00.196272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fbd0a-cf4f-4c83-93c6-e0c7aa90ddc8 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:00.214088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-46bae351-276b-45d1-96cc-acd0303ad0f3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:00.216301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-46bae351-276b-45d1-96cc-acd0303ad0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:00.231085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:00.289335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 146/287] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:00.293656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 142/288] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:39:00 2022] PUT /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/users/69fecc54ad044bcabf5e0c4596312653/roles/bfe83dde5e854daeb7b29edf7171f8d7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:00.313608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bae351-276b-45d1-96cc-acd0303ad0f3 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:00.446592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bae351-276b-45d1-96cc-acd0303ad0f3 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:00.494681 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306437-8cd8-4ceb-9890-8e68eb7262a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:00.495543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306437-8cd8-4ceb-9890-8e68eb7262a1 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:00.495795 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306437-8cd8-4ceb-9890-8e68eb7262a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:00.496067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306437-8cd8-4ceb-9890-8e68eb7262a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:00.507489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7306437-8cd8-4ceb-9890-8e68eb7262a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-d7306437-8cd8-4ceb-9890-8e68eb7262a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:00.519734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:00.520724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:00.522197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 147/289] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:00.526858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fbd0a-cf4f-4c83-93c6-e0c7aa90ddc8 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:00.655171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fbd0a-cf4f-4c83-93c6-e0c7aa90ddc8 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:00.683358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:00.694830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b142ac-a6ac-4bee-bc69-a1a093f68781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:00.699179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b142ac-a6ac-4bee-bc69-a1a093f68781 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:00.699179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b142ac-a6ac-4bee-bc69-a1a093f68781 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:00.699179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b142ac-a6ac-4bee-bc69-a1a093f68781 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:00.699179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b142ac-a6ac-4bee-bc69-a1a093f68781 None admin] RBAC: Adding query filter params (name=member) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:00.699179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b142ac-a6ac-4bee-bc69-a1a093f68781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:00.699179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b142ac-a6ac-4bee-bc69-a1a093f68781 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:00.708103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 143/290] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:00.713489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306437-8cd8-4ceb-9890-8e68eb7262a1 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:00.733754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:00.851645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306437-8cd8-4ceb-9890-8e68eb7262a1 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:00.905776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e2168-6316-4c7c-8ec6-87473deffe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:00.906657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e2168-6316-4c7c-8ec6-87473deffe74 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:00.906939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e2168-6316-4c7c-8ec6-87473deffe74 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:00.907241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e2168-6316-4c7c-8ec6-87473deffe74 None admin] PATH_INFO: `/v3/users/7534e9c09daf415285169f53d20696e5` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:00.908468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e2168-6316-4c7c-8ec6-87473deffe74 None admin] RBAC: Authorizing `identity:get_user(user_id=7534e9c09daf415285169f53d20696e5)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:00.909929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e2168-6316-4c7c-8ec6-87473deffe74 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:00.911994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 148/291] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:39:00 2022] GET /identity/v3/users/7534e9c09daf415285169f53d20696e5 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:00.917456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b142ac-a6ac-4bee-bc69-a1a093f68781 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:01.066085 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b142ac-a6ac-4bee-bc69-a1a093f68781 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:01.117136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d77330-b303-4026-8eae-05b04d914f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:01.117724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d77330-b303-4026-8eae-05b04d914f31 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:01.118005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d77330-b303-4026-8eae-05b04d914f31 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:01.118279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d77330-b303-4026-8eae-05b04d914f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:01.199204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:01.221734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d77330-b303-4026-8eae-05b04d914f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:01.223255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d77330-b303-4026-8eae-05b04d914f31 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:01.336079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 144/292] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:01.344228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e2168-6316-4c7c-8ec6-87473deffe74 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:01.481076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:01.510773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e2168-6316-4c7c-8ec6-87473deffe74 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:01.561344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190bfee-a091-4e0f-9885-b7c1db10b979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:01.562377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190bfee-a091-4e0f-9885-b7c1db10b979 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:01.562662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190bfee-a091-4e0f-9885-b7c1db10b979 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:01.562938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190bfee-a091-4e0f-9885-b7c1db10b979 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:01.564155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190bfee-a091-4e0f-9885-b7c1db10b979 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:01.565587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190bfee-a091-4e0f-9885-b7c1db10b979 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:01.567615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 149/293] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:01 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:01.576161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d77330-b303-4026-8eae-05b04d914f31 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:01.678080 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8152f8a-26ae-4af6-97df-fb7cd3d39db5 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:01.678367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8152f8a-26ae-4af6-97df-fb7cd3d39db5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:01.678643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8152f8a-26ae-4af6-97df-fb7cd3d39db5 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:01.680288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 150/294] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:01.685312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b3eac-646f-41ed-a9a0-a2e10728f5af None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:01.685593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b3eac-646f-41ed-a9a0-a2e10728f5af None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:01.685867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b3eac-646f-41ed-a9a0-a2e10728f5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:01.691268 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:01.704583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-bf3b3eac-646f-41ed-a9a0-a2e10728f5af None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:01.705826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bf3b3eac-646f-41ed-a9a0-a2e10728f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:01.706198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d77330-b303-4026-8eae-05b04d914f31 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:01.763528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20217bff-a761-4d8e-8730-c2c5f39389e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:01.764120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20217bff-a761-4d8e-8730-c2c5f39389e4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:01.764402 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20217bff-a761-4d8e-8730-c2c5f39389e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:01.764681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20217bff-a761-4d8e-8730-c2c5f39389e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:01.765521 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20217bff-a761-4d8e-8730-c2c5f39389e4 None admin] RBAC: Adding query filter params (role.id=1067c35f1111496c983a6a7dec2a5ad9, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c, user.id=7534e9c09daf415285169f53d20696e5) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:01.765836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20217bff-a761-4d8e-8730-c2c5f39389e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:01.767323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20217bff-a761-4d8e-8730-c2c5f39389e4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:01.783581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 145/295] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:01 2022] GET /identity/v3/role_assignments?user.id=7534e9c09daf415285169f53d20696e5&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:01.814635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 151/296] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:01.841243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20217bff-a761-4d8e-8730-c2c5f39389e4 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:01.990076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20217bff-a761-4d8e-8730-c2c5f39389e4 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:02.035269 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed5e7d-a074-45fc-8229-923537784695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:02.036041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed5e7d-a074-45fc-8229-923537784695 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.036342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed5e7d-a074-45fc-8229-923537784695 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.036631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed5e7d-a074-45fc-8229-923537784695 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.053112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed5e7d-a074-45fc-8229-923537784695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-44ed5e7d-a074-45fc-8229-923537784695 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:02.063005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:02.063909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:02.064668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 146/297] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:02.073142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b3eac-646f-41ed-a9a0-a2e10728f5af None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:02.162875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:02.194807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b3eac-646f-41ed-a9a0-a2e10728f5af None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:02.235347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d8116-9b1b-4b49-add9-a5171801378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:02.236341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d8116-9b1b-4b49-add9-a5171801378a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.236859 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d8116-9b1b-4b49-add9-a5171801378a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.237329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d8116-9b1b-4b49-add9-a5171801378a None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.238307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d8116-9b1b-4b49-add9-a5171801378a None admin] RBAC: Adding query filter params (name=member) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:02.238808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d8116-9b1b-4b49-add9-a5171801378a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:02.240379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d8116-9b1b-4b49-add9-a5171801378a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:02.251409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 152/298] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:02.258160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed5e7d-a074-45fc-8229-923537784695 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:02.280422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:02.387481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed5e7d-a074-45fc-8229-923537784695 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:02.391020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d2665-1f68-4ec7-a1da-05efa93008c4 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.391020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d2665-1f68-4ec7-a1da-05efa93008c4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.391618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d2665-1f68-4ec7-a1da-05efa93008c4 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.393601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 153/299] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:39:02.398854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb617b-d824-46d3-97d2-76d328ebe3fa None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.399402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb617b-d824-46d3-97d2-76d328ebe3fa None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.399874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb617b-d824-46d3-97d2-76d328ebe3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.417382 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-86bb617b-d824-46d3-97d2-76d328ebe3fa None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:02.419591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-86bb617b-d824-46d3-97d2-76d328ebe3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:02.425627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a654c6-b21f-45c9-a85d-8d78e4aadb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:02.426506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a654c6-b21f-45c9-a85d-8d78e4aadb92 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.426785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a654c6-b21f-45c9-a85d-8d78e4aadb92 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.427084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a654c6-b21f-45c9-a85d-8d78e4aadb92 None admin] PATH_INFO: `/v3/users/e7be7d2132ce441b8e7518a9f5d657cd` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.428323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a654c6-b21f-45c9-a85d-8d78e4aadb92 None admin] RBAC: Authorizing `identity:get_user(user_id=e7be7d2132ce441b8e7518a9f5d657cd)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:02.429933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a654c6-b21f-45c9-a85d-8d78e4aadb92 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:02.431606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 147/300] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:39:02 2022] GET /identity/v3/users/e7be7d2132ce441b8e7518a9f5d657cd => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:02.437344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a654c6-b21f-45c9-a85d-8d78e4aadb92 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:02.497772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 154/301] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:02.499453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c201-4aa3-4ff1-8f51-a91c8680cb4b None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.499944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c201-4aa3-4ff1-8f51-a91c8680cb4b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.500411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164c201-4aa3-4ff1-8f51-a91c8680cb4b None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.501881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 155/302] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:02.508183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc114b-a132-486f-b0dc-86bd2bec2592 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.508704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc114b-a132-486f-b0dc-86bd2bec2592 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.509421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc114b-a132-486f-b0dc-86bd2bec2592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.522314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:02.530854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b6cc114b-a132-486f-b0dc-86bd2bec2592 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:02.532069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b6cc114b-a132-486f-b0dc-86bd2bec2592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:02.548401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a654c6-b21f-45c9-a85d-8d78e4aadb92 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:02.587683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448084-888f-486a-a222-4e38b4a0be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:02.588603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448084-888f-486a-a222-4e38b4a0be3f None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.588885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448084-888f-486a-a222-4e38b4a0be3f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.589207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448084-888f-486a-a222-4e38b4a0be3f None admin] PATH_INFO: `/v3/system/users/e7be7d2132ce441b8e7518a9f5d657cd/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.591272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f448084-888f-486a-a222-4e38b4a0be3f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e7be7d2132ce441b8e7518a9f5d657cd, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:02.592713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f448084-888f-486a-a222-4e38b4a0be3f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:02.598290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:02.605539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 156/303] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:02.607860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc114b-a132-486f-b0dc-86bd2bec2592 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:02.714996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 148/304] 10.222.0.42 () {58 vars in 1334 bytes} [Fri May 27 13:39:02 2022] PUT /identity/v3/system/users/e7be7d2132ce441b8e7518a9f5d657cd/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 13:39:02.715254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc114b-a132-486f-b0dc-86bd2bec2592 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:02.715341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448084-888f-486a-a222-4e38b4a0be3f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:02.752478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb4de4-0c0e-41f2-8415-ad2f0ec76e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:02.753690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb4de4-0c0e-41f2-8415-ad2f0ec76e4c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.754071 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb4de4-0c0e-41f2-8415-ad2f0ec76e4c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.754354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb4de4-0c0e-41f2-8415-ad2f0ec76e4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.756340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb4de4-0c0e-41f2-8415-ad2f0ec76e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:02.758215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb4de4-0c0e-41f2-8415-ad2f0ec76e4c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:02.766780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 157/305] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:02.769144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb4de4-0c0e-41f2-8415-ad2f0ec76e4c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:02.863870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448084-888f-486a-a222-4e38b4a0be3f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:02.872169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:02.908619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2ed40-f860-4a24-8f4e-ab94ef0adbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:02.909423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ed40-f860-4a24-8f4e-ab94ef0adbf1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.909706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ed40-f860-4a24-8f4e-ab94ef0adbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.909979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f2ed40-f860-4a24-8f4e-ab94ef0adbf1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.921380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:02.925701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f2ed40-f860-4a24-8f4e-ab94ef0adbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:02.927730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb4de4-0c0e-41f2-8415-ad2f0ec76e4c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-40f2ed40-f860-4a24-8f4e-ab94ef0adbf1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:02.942732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:02.943842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 149/306] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:02.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2ed40-f860-4a24-8f4e-ab94ef0adbf1 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:02.984120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05473b-8ef0-4aff-b932-1c00a5fd0b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:02.985205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05473b-8ef0-4aff-b932-1c00a5fd0b60 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:02.985878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05473b-8ef0-4aff-b932-1c00a5fd0b60 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:02.986360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05473b-8ef0-4aff-b932-1c00a5fd0b60 None admin] PATH_INFO: `/v3/groups` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:02.987875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05473b-8ef0-4aff-b932-1c00a5fd0b60 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:02.989329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05473b-8ef0-4aff-b932-1c00a5fd0b60 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:03.060827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f2ed40-f860-4a24-8f4e-ab94ef0adbf1 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:03.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 158/307] 10.222.0.42 () {60 vars in 1134 bytes} [Fri May 27 13:39:02 2022] POST /identity/v3/groups => generated 229 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:39:03.105132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b8ecd-88dd-412b-b968-7a6cbc2cda42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:03.106226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b8ecd-88dd-412b-b968-7a6cbc2cda42 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:03.106713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b8ecd-88dd-412b-b968-7a6cbc2cda42 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:03.107340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b8ecd-88dd-412b-b968-7a6cbc2cda42 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:03.108550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b8ecd-88dd-412b-b968-7a6cbc2cda42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:03.109126 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b8ecd-88dd-412b-b968-7a6cbc2cda42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:03.111008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b8ecd-88dd-412b-b968-7a6cbc2cda42 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:03.123589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 150/308] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:03.132214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05473b-8ef0-4aff-b932-1c00a5fd0b60 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:03.156736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be76ac-e8cb-436a-8997-d3050cacbdb7 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:03.157509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be76ac-e8cb-436a-8997-d3050cacbdb7 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:03.158103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be76ac-e8cb-436a-8997-d3050cacbdb7 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:03.163533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 151/309] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:03.171022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1ecf5-a125-4e9d-a702-b9fc3b9d98ba None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:03.171022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1ecf5-a125-4e9d-a702-b9fc3b9d98ba None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:03.171022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1ecf5-a125-4e9d-a702-b9fc3b9d98ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:03.194343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fdc1ecf5-a125-4e9d-a702-b9fc3b9d98ba None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:03.195872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fdc1ecf5-a125-4e9d-a702-b9fc3b9d98ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:03.279549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05473b-8ef0-4aff-b932-1c00a5fd0b60 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:03.286495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:03.307218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 152/310] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:03.313655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:03.331476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61074cac-3a0d-416f-8141-8f0f1276a9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:03.332268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61074cac-3a0d-416f-8141-8f0f1276a9a2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:03.332444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1ecf5-a125-4e9d-a702-b9fc3b9d98ba None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:03.332560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61074cac-3a0d-416f-8141-8f0f1276a9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:03.332837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61074cac-3a0d-416f-8141-8f0f1276a9a2 None admin] PATH_INFO: `/v3/users/53caebc2e2c444b8b6ec1ba0a92e9cbc` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:03.353504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61074cac-3a0d-416f-8141-8f0f1276a9a2 None admin] RBAC: Authorizing `identity:get_user(user_id=53caebc2e2c444b8b6ec1ba0a92e9cbc)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:03.355001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61074cac-3a0d-416f-8141-8f0f1276a9a2 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:03.356863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 159/311] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:39:03 2022] GET /identity/v3/users/53caebc2e2c444b8b6ec1ba0a92e9cbc => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:03.365779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61074cac-3a0d-416f-8141-8f0f1276a9a2 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:03.459197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1ecf5-a125-4e9d-a702-b9fc3b9d98ba None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:03.487614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61074cac-3a0d-416f-8141-8f0f1276a9a2 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:03.497671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8755f-0d19-44a3-87a1-262be3bb9bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:03.498830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8755f-0d19-44a3-87a1-262be3bb9bda None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:03.498944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8755f-0d19-44a3-87a1-262be3bb9bda None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:03.499234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8755f-0d19-44a3-87a1-262be3bb9bda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:03.510890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8755f-0d19-44a3-87a1-262be3bb9bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-62a8755f-0d19-44a3-87a1-262be3bb9bda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:03.519954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:03.521097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:03.522092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 153/312] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:03.527482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8755f-0d19-44a3-87a1-262be3bb9bda None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:03.531347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227b48-64f0-4f1a-980b-b32a9e56618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:03.532621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227b48-64f0-4f1a-980b-b32a9e56618c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:03.533122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227b48-64f0-4f1a-980b-b32a9e56618c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:03.533613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a227b48-64f0-4f1a-980b-b32a9e56618c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:03.534727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227b48-64f0-4f1a-980b-b32a9e56618c None admin] RBAC: Adding query filter params (role.id=bfe83dde5e854daeb7b29edf7171f8d7, user.id=53caebc2e2c444b8b6ec1ba0a92e9cbc, scope.system=all) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:03.535295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227b48-64f0-4f1a-980b-b32a9e56618c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:03.536996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a227b48-64f0-4f1a-980b-b32a9e56618c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:03.543041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 160/313] 10.222.0.42 () {56 vars in 1308 bytes} [Fri May 27 13:39:03 2022] GET /identity/v3/role_assignments?user.id=53caebc2e2c444b8b6ec1ba0a92e9cbc&scope.system=all&role.id=bfe83dde5e854daeb7b29edf7171f8d7 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:03.607536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:03.667894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8755f-0d19-44a3-87a1-262be3bb9bda None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:03.709968 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f5040-0173-490a-8e76-d2c9e1490904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:03.710570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f5040-0173-490a-8e76-d2c9e1490904 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:03.710857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f5040-0173-490a-8e76-d2c9e1490904 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:03.711170 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f5040-0173-490a-8e76-d2c9e1490904 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:03.711942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f5040-0173-490a-8e76-d2c9e1490904 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:03.712292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f5040-0173-490a-8e76-d2c9e1490904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:03.713726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f5040-0173-490a-8e76-d2c9e1490904 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:03.724831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 154/314] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:03.731000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227b48-64f0-4f1a-980b-b32a9e56618c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:03.790758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:03.841642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a227b48-64f0-4f1a-980b-b32a9e56618c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:03.879198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382139e5-37d5-4eff-b59f-0cdb9f5e74bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:03.880110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382139e5-37d5-4eff-b59f-0cdb9f5e74bf None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:03.880398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382139e5-37d5-4eff-b59f-0cdb9f5e74bf None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:03.880676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382139e5-37d5-4eff-b59f-0cdb9f5e74bf None admin] PATH_INFO: `/v3/users/69fecc54ad044bcabf5e0c4596312653` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:03.882002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382139e5-37d5-4eff-b59f-0cdb9f5e74bf None admin] RBAC: Authorizing `identity:get_user(user_id=69fecc54ad044bcabf5e0c4596312653)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:03.883498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382139e5-37d5-4eff-b59f-0cdb9f5e74bf None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:03.885543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 161/315] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:39:03 2022] GET /identity/v3/users/69fecc54ad044bcabf5e0c4596312653 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:03.892092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f5040-0173-490a-8e76-d2c9e1490904 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:04.000998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f5040-0173-490a-8e76-d2c9e1490904 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:04.016195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:04.037474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d0099-e6eb-42e1-b3be-503f44eb1e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:04.038188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d0099-e6eb-42e1-b3be-503f44eb1e87 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:04.038473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d0099-e6eb-42e1-b3be-503f44eb1e87 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:04.038785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d0099-e6eb-42e1-b3be-503f44eb1e87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:04.115097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d0099-e6eb-42e1-b3be-503f44eb1e87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:04.116654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d0099-e6eb-42e1-b3be-503f44eb1e87 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:04.219776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 155/316] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:04.225543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382139e5-37d5-4eff-b59f-0cdb9f5e74bf None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:04.366746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382139e5-37d5-4eff-b59f-0cdb9f5e74bf None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:04.381185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:04.402107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb32df7-6c72-4d3f-90de-1522b869670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:04.403075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb32df7-6c72-4d3f-90de-1522b869670f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:04.403948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb32df7-6c72-4d3f-90de-1522b869670f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:04.404223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb32df7-6c72-4d3f-90de-1522b869670f None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:04.405430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb32df7-6c72-4d3f-90de-1522b869670f None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:04.406868 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb32df7-6c72-4d3f-90de-1522b869670f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:04.409089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 162/317] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:04 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:04.415139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d0099-e6eb-42e1-b3be-503f44eb1e87 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:04.433187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:04.518771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d0099-e6eb-42e1-b3be-503f44eb1e87 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:04.553998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd58e83-036b-40f3-8e04-317028271ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:04.554654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58e83-036b-40f3-8e04-317028271ad1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:04.554932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58e83-036b-40f3-8e04-317028271ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:04.555230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd58e83-036b-40f3-8e04-317028271ad1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:04.556058 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd58e83-036b-40f3-8e04-317028271ad1 None admin] RBAC: Adding query filter params (role.id=bfe83dde5e854daeb7b29edf7171f8d7, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c, user.id=69fecc54ad044bcabf5e0c4596312653) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:04.556361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd58e83-036b-40f3-8e04-317028271ad1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:04.557807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd58e83-036b-40f3-8e04-317028271ad1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:04.564372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 156/318] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:04 2022] GET /identity/v3/role_assignments?user.id=69fecc54ad044bcabf5e0c4596312653&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=bfe83dde5e854daeb7b29edf7171f8d7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:05.018068 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e334-97c3-44a2-acad-cb9763e9c36c None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.019135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e334-97c3-44a2-acad-cb9763e9c36c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.019622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e334-97c3-44a2-acad-cb9763e9c36c None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.021214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 163/319] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:05.026560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0dc90-823d-4348-bd7d-e780733f6a90 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.026957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0dc90-823d-4348-bd7d-e780733f6a90 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.027154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0dc90-823d-4348-bd7d-e780733f6a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.045472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a3d0dc90-823d-4348-bd7d-e780733f6a90 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:05.047006 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a3d0dc90-823d-4348-bd7d-e780733f6a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:05.114255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 157/320] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:05.138296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5e334-97c3-44a2-acad-cb9763e9c36c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:05.251408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5e334-97c3-44a2-acad-cb9763e9c36c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:05.286199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c90f-66fd-4bde-a21e-9e698396c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:05.286917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c90f-66fd-4bde-a21e-9e698396c12c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.287225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c90f-66fd-4bde-a21e-9e698396c12c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.287499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440c90f-66fd-4bde-a21e-9e698396c12c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.300244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440c90f-66fd-4bde-a21e-9e698396c12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-b440c90f-66fd-4bde-a21e-9e698396c12c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:05.308203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:05.309154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:05.310416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:05.311037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 164/321] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:05.316395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0dc90-823d-4348-bd7d-e780733f6a90 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:05.329385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:05.419031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0dc90-823d-4348-bd7d-e780733f6a90 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:05.454127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb620c20-83ab-4db5-bb84-2c6458c2a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:05.454803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb620c20-83ab-4db5-bb84-2c6458c2a444 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.455118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb620c20-83ab-4db5-bb84-2c6458c2a444 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.455394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb620c20-83ab-4db5-bb84-2c6458c2a444 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.456146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb620c20-83ab-4db5-bb84-2c6458c2a444 None admin] RBAC: Adding query filter params (name=member) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:05.456452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb620c20-83ab-4db5-bb84-2c6458c2a444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:05.457855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb620c20-83ab-4db5-bb84-2c6458c2a444 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:05.466936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 158/322] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:05.472183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c90f-66fd-4bde-a21e-9e698396c12c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:05.497318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748589c-b714-4f32-ad52-6cb9c46c9e02 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.497675 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748589c-b714-4f32-ad52-6cb9c46c9e02 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.497991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748589c-b714-4f32-ad52-6cb9c46c9e02 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.499476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 159/323] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:39:05.504343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629126c-3b68-4403-991b-73f992bfb0ea None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.504541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629126c-3b68-4403-991b-73f992bfb0ea None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.505011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629126c-3b68-4403-991b-73f992bfb0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.520447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:05.524762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8629126c-3b68-4403-991b-73f992bfb0ea None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:05.526108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8629126c-3b68-4403-991b-73f992bfb0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:05.580343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440c90f-66fd-4bde-a21e-9e698396c12c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:05.601723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:05.607736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 160/324] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:05.617650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe913-427c-49b5-88e8-72d83e8ee587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:05.618811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe913-427c-49b5-88e8-72d83e8ee587 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.619308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe913-427c-49b5-88e8-72d83e8ee587 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.619762 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe913-427c-49b5-88e8-72d83e8ee587 None admin] PATH_INFO: `/v3/users/e7be7d2132ce441b8e7518a9f5d657cd` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.621126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffe913-427c-49b5-88e8-72d83e8ee587 None admin] RBAC: Authorizing `identity:get_user(user_id=e7be7d2132ce441b8e7518a9f5d657cd)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:05.623112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffe913-427c-49b5-88e8-72d83e8ee587 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:05.624972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 165/325] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:39:05 2022] GET /identity/v3/users/e7be7d2132ce441b8e7518a9f5d657cd => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:05.630479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe913-427c-49b5-88e8-72d83e8ee587 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:05.630677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629126c-3b68-4403-991b-73f992bfb0ea None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:05.742598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe913-427c-49b5-88e8-72d83e8ee587 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:05.750852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629126c-3b68-4403-991b-73f992bfb0ea None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:05.753221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:05.777186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968d51-4fcf-44a7-b233-c9d5529a4095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:05.777844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968d51-4fcf-44a7-b233-c9d5529a4095 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.778727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968d51-4fcf-44a7-b233-c9d5529a4095 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.779021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968d51-4fcf-44a7-b233-c9d5529a4095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.779964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c968d51-4fcf-44a7-b233-c9d5529a4095 None admin] RBAC: Adding query filter params (role.id=1067c35f1111496c983a6a7dec2a5ad9, user.id=e7be7d2132ce441b8e7518a9f5d657cd, scope.system=all) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:05.780277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c968d51-4fcf-44a7-b233-c9d5529a4095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:05.781791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c968d51-4fcf-44a7-b233-c9d5529a4095 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:05.788590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ec4de-72cd-4d71-81fa-20fa6ceb5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:05.789384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec4de-72cd-4d71-81fa-20fa6ceb5f84 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.789671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec4de-72cd-4d71-81fa-20fa6ceb5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.789963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ec4de-72cd-4d71-81fa-20fa6ceb5f84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.791168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ec4de-72cd-4d71-81fa-20fa6ceb5f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:05.792612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ec4de-72cd-4d71-81fa-20fa6ceb5f84 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:05.799815 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 166/326] 10.222.0.42 () {56 vars in 1308 bytes} [Fri May 27 13:39:05 2022] GET /identity/v3/role_assignments?user.id=e7be7d2132ce441b8e7518a9f5d657cd&scope.system=all&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:05.800008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 161/327] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:05.801517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968d51-4fcf-44a7-b233-c9d5529a4095 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:05.874355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13c5b-7c65-4e7c-98f6-10d73b9460dd None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.874540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13c5b-7c65-4e7c-98f6-10d73b9460dd None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.874801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa13c5b-7c65-4e7c-98f6-10d73b9460dd None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.876504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 162/328] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:39:05.882107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5ca97-44d1-46aa-9aa5-3f2c9da371f2 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.882396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5ca97-44d1-46aa-9aa5-3f2c9da371f2 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.882678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5ca97-44d1-46aa-9aa5-3f2c9da371f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.902173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-05f5ca97-44d1-46aa-9aa5-3f2c9da371f2 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:05.904199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-05f5ca97-44d1-46aa-9aa5-3f2c9da371f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:05.915086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968d51-4fcf-44a7-b233-c9d5529a4095 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:05.952560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e3b16-0d8e-42ca-a03e-7ee384e022e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:05.953227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e3b16-0d8e-42ca-a03e-7ee384e022e9 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:05.953508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e3b16-0d8e-42ca-a03e-7ee384e022e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:05.953781 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e3b16-0d8e-42ca-a03e-7ee384e022e9 None admin] PATH_INFO: `/v3/groups` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:05.954493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e3b16-0d8e-42ca-a03e-7ee384e022e9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:05.955988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e3b16-0d8e-42ca-a03e-7ee384e022e9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:05.976774 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:05.982893 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 163/329] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:06.005063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5ca97-44d1-46aa-9aa5-3f2c9da371f2 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:06.084870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 167/330] 10.222.0.42 () {60 vars in 1134 bytes} [Fri May 27 13:39:05 2022] POST /identity/v3/groups => generated 226 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:39:06.109161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5ca97-44d1-46aa-9aa5-3f2c9da371f2 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:06.146489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3e8d1-6659-4d34-81b7-8d7957d4f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:06.147250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e8d1-6659-4d34-81b7-8d7957d4f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:06.147531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e8d1-6659-4d34-81b7-8d7957d4f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:06.147802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3e8d1-6659-4d34-81b7-8d7957d4f1a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:06.159799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3e8d1-6659-4d34-81b7-8d7957d4f1a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-74a3e8d1-6659-4d34-81b7-8d7957d4f1a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:06.167608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:06.168796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:06.169906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 164/331] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:06.175554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e3b16-0d8e-42ca-a03e-7ee384e022e9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:06.207685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:06.286017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e3b16-0d8e-42ca-a03e-7ee384e022e9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:06.322375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b41ec-2b5a-453a-b0b7-71489c593560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:06.323174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b41ec-2b5a-453a-b0b7-71489c593560 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:06.323476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b41ec-2b5a-453a-b0b7-71489c593560 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:06.323749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b41ec-2b5a-453a-b0b7-71489c593560 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:06.324488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b41ec-2b5a-453a-b0b7-71489c593560 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:06.324803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b41ec-2b5a-453a-b0b7-71489c593560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:06.326748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b41ec-2b5a-453a-b0b7-71489c593560 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:06.335346 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 168/332] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:06.340870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3e8d1-6659-4d34-81b7-8d7957d4f1a6 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:06.404056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:06.448429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3e8d1-6659-4d34-81b7-8d7957d4f1a6 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:06.485540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50003d90-9f0a-4d7b-8d3a-9edc764a732e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:06.486495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50003d90-9f0a-4d7b-8d3a-9edc764a732e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:06.486810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50003d90-9f0a-4d7b-8d3a-9edc764a732e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:06.487134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50003d90-9f0a-4d7b-8d3a-9edc764a732e None admin] PATH_INFO: `/v3/users/53caebc2e2c444b8b6ec1ba0a92e9cbc` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:06.489035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50003d90-9f0a-4d7b-8d3a-9edc764a732e None admin] RBAC: Authorizing `identity:get_user(user_id=53caebc2e2c444b8b6ec1ba0a92e9cbc)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:06.490500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50003d90-9f0a-4d7b-8d3a-9edc764a732e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:06.492358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 165/333] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:39:06 2022] GET /identity/v3/users/53caebc2e2c444b8b6ec1ba0a92e9cbc => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:06.498174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b41ec-2b5a-453a-b0b7-71489c593560 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:06.601894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:06.612648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b41ec-2b5a-453a-b0b7-71489c593560 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:06.655933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a70d6-bfc9-448a-b3c8-e1640078f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:06.656739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a70d6-bfc9-448a-b3c8-e1640078f99c None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:06.657023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a70d6-bfc9-448a-b3c8-e1640078f99c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:06.657301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a70d6-bfc9-448a-b3c8-e1640078f99c None admin] PATH_INFO: `/v3/system/users/53caebc2e2c444b8b6ec1ba0a92e9cbc/roles/bfe83dde5e854daeb7b29edf7171f8d7` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:06.660437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a70d6-bfc9-448a-b3c8-e1640078f99c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=53caebc2e2c444b8b6ec1ba0a92e9cbc, role_id=bfe83dde5e854daeb7b29edf7171f8d7)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:06.661847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a70d6-bfc9-448a-b3c8-e1640078f99c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:06.737647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 169/334] 10.222.0.42 () {58 vars in 1334 bytes} [Fri May 27 13:39:06 2022] PUT /identity/v3/system/users/53caebc2e2c444b8b6ec1ba0a92e9cbc/roles/bfe83dde5e854daeb7b29edf7171f8d7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:09.027969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311551d-7535-4452-bde1-ebbd175ff82d None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:09.029110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311551d-7535-4452-bde1-ebbd175ff82d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:09.029437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311551d-7535-4452-bde1-ebbd175ff82d None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:09.031056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 166/335] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:09.036590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce634bdd-39da-40e1-8641-f0743bdaa70e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:09.037410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce634bdd-39da-40e1-8641-f0743bdaa70e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:09.037884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce634bdd-39da-40e1-8641-f0743bdaa70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:09.063980 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ce634bdd-39da-40e1-8641-f0743bdaa70e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:09.065169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ce634bdd-39da-40e1-8641-f0743bdaa70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:09.147705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 170/336] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:09.172666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311551d-7535-4452-bde1-ebbd175ff82d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:09.295274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311551d-7535-4452-bde1-ebbd175ff82d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:09.333464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:09.342775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595420c-a1f0-4f58-9968-e94c2bdb846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:09.343642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595420c-a1f0-4f58-9968-e94c2bdb846f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:09.343894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595420c-a1f0-4f58-9968-e94c2bdb846f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:09.344173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595420c-a1f0-4f58-9968-e94c2bdb846f None admin] PATH_INFO: `/v3/roles/member` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:09.363840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595420c-a1f0-4f58-9968-e94c2bdb846f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-0595420c-a1f0-4f58-9968-e94c2bdb846f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:09.372922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:09.373793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:09.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 167/337] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:09.381983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce634bdd-39da-40e1-8641-f0743bdaa70e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:09.499425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:09.511632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce634bdd-39da-40e1-8641-f0743bdaa70e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:09.547709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb4cf2-304d-4e5c-b7be-f3792255d2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:09.548547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb4cf2-304d-4e5c-b7be-f3792255d2bc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:09.548827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb4cf2-304d-4e5c-b7be-f3792255d2bc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:09.549101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb4cf2-304d-4e5c-b7be-f3792255d2bc None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:09.549862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb4cf2-304d-4e5c-b7be-f3792255d2bc None admin] RBAC: Adding query filter params (name=member) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:09.550213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb4cf2-304d-4e5c-b7be-f3792255d2bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:09.551873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb4cf2-304d-4e5c-b7be-f3792255d2bc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:09.560791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 171/338] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:09.566478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595420c-a1f0-4f58-9968-e94c2bdb846f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:09.712749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595420c-a1f0-4f58-9968-e94c2bdb846f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:09.820928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1d02c-4406-4d70-9f72-34236967e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:09.821510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1d02c-4406-4d70-9f72-34236967e43f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:09.821794 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1d02c-4406-4d70-9f72-34236967e43f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:09.822076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1d02c-4406-4d70-9f72-34236967e43f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:09.896606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:09.911188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1d02c-4406-4d70-9f72-34236967e43f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:09.912765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1d02c-4406-4d70-9f72-34236967e43f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:10.053931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04f0c-8695-4850-94ed-8f1fef4f3083 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.054483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04f0c-8695-4850-94ed-8f1fef4f3083 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.054483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a04f0c-8695-4850-94ed-8f1fef4f3083 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.056214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 168/339] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:10.057475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 172/340] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:10.062463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1d02c-4406-4d70-9f72-34236967e43f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:10.067296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe260-f42a-4d38-8931-de5eea12b4ab None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.067811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe260-f42a-4d38-8931-de5eea12b4ab None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.068224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbe260-f42a-4d38-8931-de5eea12b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.097558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-37fbe260-f42a-4d38-8931-de5eea12b4ab None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:10.098996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-37fbe260-f42a-4d38-8931-de5eea12b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:10.185471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 173/341] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:10.187433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951bc6f-b726-474e-9d5a-d9138fd07e78 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.187863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951bc6f-b726-474e-9d5a-d9138fd07e78 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.188275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951bc6f-b726-474e-9d5a-d9138fd07e78 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.195079 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 174/342] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:10.196604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ced78-7614-45b2-bad2-c0dadf87cc40 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.197026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ced78-7614-45b2-bad2-c0dadf87cc40 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.197449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ced78-7614-45b2-bad2-c0dadf87cc40 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.198861 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 175/343] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:10.201493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:10.205106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e2d46-dd05-4ac6-bae0-e5016e92b028 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.205565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e2d46-dd05-4ac6-bae0-e5016e92b028 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.205989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e2d46-dd05-4ac6-bae0-e5016e92b028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.219317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1d02c-4406-4d70-9f72-34236967e43f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:10.236149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-742e2d46-dd05-4ac6-bae0-e5016e92b028 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:10.237362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-742e2d46-dd05-4ac6-bae0-e5016e92b028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:10.261084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5f9f3-cec9-4102-afe2-8752e9e9aeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:10.261956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5f9f3-cec9-4102-afe2-8752e9e9aeb3 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.262244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5f9f3-cec9-4102-afe2-8752e9e9aeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.263092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5f9f3-cec9-4102-afe2-8752e9e9aeb3 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.264817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5f9f3-cec9-4102-afe2-8752e9e9aeb3 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:10.266597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5f9f3-cec9-4102-afe2-8752e9e9aeb3 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:10.271208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 169/344] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:10 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:10.272642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd0cbb-6622-4c86-9cc8-5e07d27c2900 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.273061 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd0cbb-6622-4c86-9cc8-5e07d27c2900 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.273465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd0cbb-6622-4c86-9cc8-5e07d27c2900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.301407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8bcd0cbb-6622-4c86-9cc8-5e07d27c2900 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:10.303519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8bcd0cbb-6622-4c86-9cc8-5e07d27c2900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:10.330602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 176/345] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:10.331744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e2d46-dd05-4ac6-bae0-e5016e92b028 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:10.342808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:10.404379 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 170/346] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:10.411962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd0cbb-6622-4c86-9cc8-5e07d27c2900 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:10.461212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e2d46-dd05-4ac6-bae0-e5016e92b028 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:10.502816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64de2d9-3d19-4518-83ec-5df8dc58524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:10.503674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64de2d9-3d19-4518-83ec-5df8dc58524c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.506532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64de2d9-3d19-4518-83ec-5df8dc58524c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.506532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64de2d9-3d19-4518-83ec-5df8dc58524c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.519256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:10.520562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64de2d9-3d19-4518-83ec-5df8dc58524c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-d64de2d9-3d19-4518-83ec-5df8dc58524c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:10.529344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:10.536886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 177/347] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:39:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:10.537725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ca8e-881f-4565-8cc4-d5269e66d448 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.540282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ca8e-881f-4565-8cc4-d5269e66d448 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.540282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ca8e-881f-4565-8cc4-d5269e66d448 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.540282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 178/348] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:10.540282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08ca8e-881f-4565-8cc4-d5269e66d448 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:10.543889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd0cbb-6622-4c86-9cc8-5e07d27c2900 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:10.591433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99127590-328c-43b2-bc7b-06829da84b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:10.592565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127590-328c-43b2-bc7b-06829da84b18 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.592856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127590-328c-43b2-bc7b-06829da84b18 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.593137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99127590-328c-43b2-bc7b-06829da84b18 None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.602014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99127590-328c-43b2-bc7b-06829da84b18 None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:10.603545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99127590-328c-43b2-bc7b-06829da84b18 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:10.605275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 171/349] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:10 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:10.606037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99127590-328c-43b2-bc7b-06829da84b18 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:10.630332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:10.684071 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08ca8e-881f-4565-8cc4-d5269e66d448 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:10.723585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0365c1f-9e0e-49a7-8d10-f5c7f74309e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:10.724781 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0365c1f-9e0e-49a7-8d10-f5c7f74309e5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.725196 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0365c1f-9e0e-49a7-8d10-f5c7f74309e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.725632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0365c1f-9e0e-49a7-8d10-f5c7f74309e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.738458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0365c1f-9e0e-49a7-8d10-f5c7f74309e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-f0365c1f-9e0e-49a7-8d10-f5c7f74309e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:10.746425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:10.748683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:10.749857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:10.752025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99127590-328c-43b2-bc7b-06829da84b18 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:10.753011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 179/350] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:10.753946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0365c1f-9e0e-49a7-8d10-f5c7f74309e5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:10.796576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad59e3f-3ec5-4a16-a1d8-89669acbae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:10.797398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59e3f-3ec5-4a16-a1d8-89669acbae99 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.797679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59e3f-3ec5-4a16-a1d8-89669acbae99 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.798201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad59e3f-3ec5-4a16-a1d8-89669acbae99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.813077 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad59e3f-3ec5-4a16-a1d8-89669acbae99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-aad59e3f-3ec5-4a16-a1d8-89669acbae99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:10.823757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:10.824708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:10.825548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 172/351] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:39:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:10.826661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736479f-0749-4250-ab63-be05f0039f11 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.826864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736479f-0749-4250-ab63-be05f0039f11 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.827118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736479f-0749-4250-ab63-be05f0039f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.845654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-7736479f-0749-4250-ab63-be05f0039f11 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:10.847004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7736479f-0749-4250-ab63-be05f0039f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:10.849028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:10.879886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0365c1f-9e0e-49a7-8d10-f5c7f74309e5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:10.911730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:10.924215 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 173/352] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:10.925335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736479f-0749-4250-ab63-be05f0039f11 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:10.925441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8d024-9aee-42e0-b9ed-a72b91cfeec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:10.926155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8d024-9aee-42e0-b9ed-a72b91cfeec3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:10.926449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8d024-9aee-42e0-b9ed-a72b91cfeec3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:10.936428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8d024-9aee-42e0-b9ed-a72b91cfeec3 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:10.936428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8d024-9aee-42e0-b9ed-a72b91cfeec3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:10.936428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8d024-9aee-42e0-b9ed-a72b91cfeec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:10.936428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8d024-9aee-42e0-b9ed-a72b91cfeec3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:10.940134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 180/353] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:10.941251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8d024-9aee-42e0-b9ed-a72b91cfeec3 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:11.048621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736479f-0749-4250-ab63-be05f0039f11 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:11.071824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8d024-9aee-42e0-b9ed-a72b91cfeec3 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:11.087932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25563f9f-5b45-4457-a3be-784d6a3a7ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:11.088599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25563f9f-5b45-4457-a3be-784d6a3a7ae2 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:11.088888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25563f9f-5b45-4457-a3be-784d6a3a7ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:11.090452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25563f9f-5b45-4457-a3be-784d6a3a7ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:11.090452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25563f9f-5b45-4457-a3be-784d6a3a7ae2 None admin] RBAC: Adding query filter params (group.id=de0abe9219324d18831cd1fa62d42082, role.id=1067c35f1111496c983a6a7dec2a5ad9, scope.project.id=b3755fb9019c4a62a3376df0865a1020) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:11.090452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25563f9f-5b45-4457-a3be-784d6a3a7ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:11.092995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25563f9f-5b45-4457-a3be-784d6a3a7ae2 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:11.100642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 174/354] 10.222.0.42 () {56 vars in 1376 bytes} [Fri May 27 13:39:10 2022] GET /identity/v3/role_assignments?group.id=de0abe9219324d18831cd1fa62d42082&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:11.101630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25563f9f-5b45-4457-a3be-784d6a3a7ae2 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:11.104365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:11.134314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e8f15-0f74-4ee3-8564-f465607037dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:11.135085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e8f15-0f74-4ee3-8564-f465607037dc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:11.135363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e8f15-0f74-4ee3-8564-f465607037dc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:11.135641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e8f15-0f74-4ee3-8564-f465607037dc None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:11.137061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e8f15-0f74-4ee3-8564-f465607037dc None admin] RBAC: Adding query filter params (name=member) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:11.137061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e8f15-0f74-4ee3-8564-f465607037dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:11.138499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e8f15-0f74-4ee3-8564-f465607037dc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:11.150942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 181/355] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:11.152317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9abe7-9d73-4a6b-bc08-b41da717e5ea None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:11.152608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9abe7-9d73-4a6b-bc08-b41da717e5ea None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:11.152889 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9abe7-9d73-4a6b-bc08-b41da717e5ea None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:11.154362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 182/356] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:11.154949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9abe7-9d73-4a6b-bc08-b41da717e5ea None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:11.236364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:11.265226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25563f9f-5b45-4457-a3be-784d6a3a7ae2 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:11.318536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9abe7-9d73-4a6b-bc08-b41da717e5ea None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:11.327890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8265-8b4b-48f1-9ac1-eccb249782b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:11.328086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8265-8b4b-48f1-9ac1-eccb249782b7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:11.328528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8265-8b4b-48f1-9ac1-eccb249782b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:11.328692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8265-8b4b-48f1-9ac1-eccb249782b7 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:11.329417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf8265-8b4b-48f1-9ac1-eccb249782b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:11.329727 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf8265-8b4b-48f1-9ac1-eccb249782b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:11.332371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf8265-8b4b-48f1-9ac1-eccb249782b7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:11.343648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 175/357] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:11.348000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8265-8b4b-48f1-9ac1-eccb249782b7 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:11.357663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1ee5f-dc3d-4eaf-8a2c-efc440f71dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:11.358490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1ee5f-dc3d-4eaf-8a2c-efc440f71dba None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:11.358776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1ee5f-dc3d-4eaf-8a2c-efc440f71dba None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:11.359315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1ee5f-dc3d-4eaf-8a2c-efc440f71dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:11.432156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:11.447420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1ee5f-dc3d-4eaf-8a2c-efc440f71dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:11.448965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1ee5f-dc3d-4eaf-8a2c-efc440f71dba None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:11.484783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8265-8b4b-48f1-9ac1-eccb249782b7 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:11.520668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:11.530627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78a013-676d-4d12-afd9-322052e28a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:11.531503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78a013-676d-4d12-afd9-322052e28a6e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:11.531849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78a013-676d-4d12-afd9-322052e28a6e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:11.532147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78a013-676d-4d12-afd9-322052e28a6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:11.545863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78a013-676d-4d12-afd9-322052e28a6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-9f78a013-676d-4d12-afd9-322052e28a6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:11.554133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:11.555150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:11.556023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 176/358] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:11.556672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba0c7a-6d75-4eae-8a01-e5aec0d73785 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:11.557124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba0c7a-6d75-4eae-8a01-e5aec0d73785 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:11.557225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba0c7a-6d75-4eae-8a01-e5aec0d73785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:11.579725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-e3ba0c7a-6d75-4eae-8a01-e5aec0d73785 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:11.580809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e3ba0c7a-6d75-4eae-8a01-e5aec0d73785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:11.591115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 183/359] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:11.592139 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1ee5f-dc3d-4eaf-8a2c-efc440f71dba None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:11.665923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 177/360] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:11.667259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba0c7a-6d75-4eae-8a01-e5aec0d73785 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:11.741014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1ee5f-dc3d-4eaf-8a2c-efc440f71dba None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:11.746300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:11.787947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424b5e3-fda3-417e-b9e4-fba25d4f894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:11.787947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424b5e3-fda3-417e-b9e4-fba25d4f894a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:11.788231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424b5e3-fda3-417e-b9e4-fba25d4f894a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:11.788355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424b5e3-fda3-417e-b9e4-fba25d4f894a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:11.811647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:11.814027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba0c7a-6d75-4eae-8a01-e5aec0d73785 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:11.858346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada83087-0fbf-4cad-89e0-708ea4df25ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:11.859086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada83087-0fbf-4cad-89e0-708ea4df25ff None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:11.859409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada83087-0fbf-4cad-89e0-708ea4df25ff None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:11.859681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada83087-0fbf-4cad-89e0-708ea4df25ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:11.877827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424b5e3-fda3-417e-b9e4-fba25d4f894a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:11.879788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424b5e3-fda3-417e-b9e4-fba25d4f894a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:11.960643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada83087-0fbf-4cad-89e0-708ea4df25ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:11.962151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada83087-0fbf-4cad-89e0-708ea4df25ff None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:12.009816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 184/361] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:12.010757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424b5e3-fda3-417e-b9e4-fba25d4f894a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.036565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:12.081811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:12.103356 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 178/362] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:12.104331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada83087-0fbf-4cad-89e0-708ea4df25ff None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.150452 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424b5e3-fda3-417e-b9e4-fba25d4f894a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:12.197659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a676c1a-b604-4fc9-93cc-d0df345f20e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:12.198337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a676c1a-b604-4fc9-93cc-d0df345f20e4 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:12.198620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a676c1a-b604-4fc9-93cc-d0df345f20e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:12.198896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a676c1a-b604-4fc9-93cc-d0df345f20e4 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:12.200359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a676c1a-b604-4fc9-93cc-d0df345f20e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:12.200738 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a676c1a-b604-4fc9-93cc-d0df345f20e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:12.202618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a676c1a-b604-4fc9-93cc-d0df345f20e4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:12.212231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 185/363] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:12.217355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a676c1a-b604-4fc9-93cc-d0df345f20e4 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.236914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada83087-0fbf-4cad-89e0-708ea4df25ff None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:12.289665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ec7d1-2e03-4c9a-bc3b-7818e9f1d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:12.290540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ec7d1-2e03-4c9a-bc3b-7818e9f1d633 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:12.290822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ec7d1-2e03-4c9a-bc3b-7818e9f1d633 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:12.291124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ec7d1-2e03-4c9a-bc3b-7818e9f1d633 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:12.292888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ec7d1-2e03-4c9a-bc3b-7818e9f1d633 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:12.294379 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ec7d1-2e03-4c9a-bc3b-7818e9f1d633 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:12.296334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 179/364] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:12.297000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ec7d1-2e03-4c9a-bc3b-7818e9f1d633 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.330052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:12.347734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a676c1a-b604-4fc9-93cc-d0df345f20e4 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:12.361926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:12.386467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000f7b2-8a70-4e08-9cde-28949421a7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:12.387289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000f7b2-8a70-4e08-9cde-28949421a7e2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:12.388161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000f7b2-8a70-4e08-9cde-28949421a7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:12.388437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000f7b2-8a70-4e08-9cde-28949421a7e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:12.400001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000f7b2-8a70-4e08-9cde-28949421a7e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-8000f7b2-8a70-4e08-9cde-28949421a7e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:12.407983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:12.408886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:12.409680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:12.412257 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 186/365] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:12.413459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000f7b2-8a70-4e08-9cde-28949421a7e2 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.428658 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ec7d1-2e03-4c9a-bc3b-7818e9f1d633 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:12.465274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e396dd9-6916-4cdb-8a25-5702135d438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:12.466280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e396dd9-6916-4cdb-8a25-5702135d438f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:12.466457 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e396dd9-6916-4cdb-8a25-5702135d438f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:12.466685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e396dd9-6916-4cdb-8a25-5702135d438f None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:12.467885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e396dd9-6916-4cdb-8a25-5702135d438f None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:12.469345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e396dd9-6916-4cdb-8a25-5702135d438f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:12.475310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 180/366] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:12.475310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e396dd9-6916-4cdb-8a25-5702135d438f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.526382 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000f7b2-8a70-4e08-9cde-28949421a7e2 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:12.563234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74187785-9bb8-45e3-9321-0ec145f0fa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:12.564367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74187785-9bb8-45e3-9321-0ec145f0fa9c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:12.564834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74187785-9bb8-45e3-9321-0ec145f0fa9c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:12.565189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74187785-9bb8-45e3-9321-0ec145f0fa9c None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:12.566467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74187785-9bb8-45e3-9321-0ec145f0fa9c None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:12.568215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74187785-9bb8-45e3-9321-0ec145f0fa9c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:12.574640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 187/367] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:12.574640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74187785-9bb8-45e3-9321-0ec145f0fa9c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.576286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:12.581840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e396dd9-6916-4cdb-8a25-5702135d438f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:12.619835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:12.620482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171537ea-ce6e-4cf1-a9ac-684d458ed0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:12.621627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171537ea-ce6e-4cf1-a9ac-684d458ed0e6 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:12.622478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171537ea-ce6e-4cf1-a9ac-684d458ed0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:12.622921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171537ea-ce6e-4cf1-a9ac-684d458ed0e6 None admin] PATH_INFO: `/v3/users/53caebc2e2c444b8b6ec1ba0a92e9cbc` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:12.624188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171537ea-ce6e-4cf1-a9ac-684d458ed0e6 None admin] RBAC: Authorizing `identity:get_user(user_id=53caebc2e2c444b8b6ec1ba0a92e9cbc)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:12.625676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171537ea-ce6e-4cf1-a9ac-684d458ed0e6 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:12.627346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 181/368] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/users/53caebc2e2c444b8b6ec1ba0a92e9cbc => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:12.628164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171537ea-ce6e-4cf1-a9ac-684d458ed0e6 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.690313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74187785-9bb8-45e3-9321-0ec145f0fa9c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:12.726772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1acdbf-5657-4960-80ce-c98186ada0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:12.727424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1acdbf-5657-4960-80ce-c98186ada0ab None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:12.727704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1acdbf-5657-4960-80ce-c98186ada0ab None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:12.727977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1acdbf-5657-4960-80ce-c98186ada0ab None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:12.729122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1acdbf-5657-4960-80ce-c98186ada0ab None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:12.730716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1acdbf-5657-4960-80ce-c98186ada0ab None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:12.733081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 188/369] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:12.738858 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1acdbf-5657-4960-80ce-c98186ada0ab None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.740178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171537ea-ce6e-4cf1-a9ac-684d458ed0e6 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:12.776940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698802b-c63e-4890-9555-a9fac68b0d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:12.777609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698802b-c63e-4890-9555-a9fac68b0d7c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:12.777902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698802b-c63e-4890-9555-a9fac68b0d7c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:12.778153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698802b-c63e-4890-9555-a9fac68b0d7c None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:12.778905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698802b-c63e-4890-9555-a9fac68b0d7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:12.779238 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698802b-c63e-4890-9555-a9fac68b0d7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:12.781168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698802b-c63e-4890-9555-a9fac68b0d7c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:12.794474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 182/370] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:12.794474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698802b-c63e-4890-9555-a9fac68b0d7c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.814024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:12.854253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1acdbf-5657-4960-80ce-c98186ada0ab None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:12.866030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:12.892111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594155-0a70-4498-92c2-8987ee97ac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:12.892885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594155-0a70-4498-92c2-8987ee97ac65 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:12.893165 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594155-0a70-4498-92c2-8987ee97ac65 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:12.893440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594155-0a70-4498-92c2-8987ee97ac65 None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:12.894610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02594155-0a70-4498-92c2-8987ee97ac65 None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:12.895735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698802b-c63e-4890-9555-a9fac68b0d7c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:12.896142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02594155-0a70-4498-92c2-8987ee97ac65 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:12.902493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 189/371] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:12.902493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594155-0a70-4498-92c2-8987ee97ac65 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:12.936557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152577-c5a9-4fef-b61c-2b46244e28fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:12.937424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152577-c5a9-4fef-b61c-2b46244e28fd None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:12.937707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152577-c5a9-4fef-b61c-2b46244e28fd None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:12.937985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152577-c5a9-4fef-b61c-2b46244e28fd None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:12.939192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152577-c5a9-4fef-b61c-2b46244e28fd None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:12.940647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4152577-c5a9-4fef-b61c-2b46244e28fd None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:12.947253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 183/372] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:12.947253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152577-c5a9-4fef-b61c-2b46244e28fd None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:13.014694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594155-0a70-4498-92c2-8987ee97ac65 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:13.042795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:13.052002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9dcae-42b0-4028-bf9d-50f18296e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:13.052656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9dcae-42b0-4028-bf9d-50f18296e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:13.052934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9dcae-42b0-4028-bf9d-50f18296e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:13.053203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9dcae-42b0-4028-bf9d-50f18296e4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:13.054023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9dcae-42b0-4028-bf9d-50f18296e4a2 None admin] RBAC: Adding query filter params (role.id=bfe83dde5e854daeb7b29edf7171f8d7, user.id=53caebc2e2c444b8b6ec1ba0a92e9cbc, scope.system=all) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:13.054351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9dcae-42b0-4028-bf9d-50f18296e4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:13.055426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152577-c5a9-4fef-b61c-2b46244e28fd None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:13.055790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9dcae-42b0-4028-bf9d-50f18296e4a2 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:13.078996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 190/373] 10.222.0.42 () {56 vars in 1308 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/role_assignments?user.id=53caebc2e2c444b8b6ec1ba0a92e9cbc&scope.system=all&role.id=bfe83dde5e854daeb7b29edf7171f8d7 => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:13.078996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9dcae-42b0-4028-bf9d-50f18296e4a2 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:13.104521 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74041047-1178-46cc-bf3a-5281dba06827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:13.105504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74041047-1178-46cc-bf3a-5281dba06827 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:13.105795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74041047-1178-46cc-bf3a-5281dba06827 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:13.106748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74041047-1178-46cc-bf3a-5281dba06827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:13.108005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74041047-1178-46cc-bf3a-5281dba06827 None admin] RBAC: Adding query filter params (group.id=de0abe9219324d18831cd1fa62d42082, role.id=a97f5aba7e1b4044b2c749cba5d5708f, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:13.108005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74041047-1178-46cc-bf3a-5281dba06827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:13.109475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74041047-1178-46cc-bf3a-5281dba06827 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:13.116201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 184/374] 10.222.0.42 () {56 vars in 1376 bytes} [Fri May 27 13:39:12 2022] GET /identity/v3/role_assignments?group.id=de0abe9219324d18831cd1fa62d42082&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=a97f5aba7e1b4044b2c749cba5d5708f => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:13.117157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74041047-1178-46cc-bf3a-5281dba06827 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:13.124456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:13.275169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9dcae-42b0-4028-bf9d-50f18296e4a2 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:13.319001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b4609-fc43-42dd-9eb5-b2cfb146199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:13.319001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4609-fc43-42dd-9eb5-b2cfb146199f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:13.319001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4609-fc43-42dd-9eb5-b2cfb146199f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:13.319001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4609-fc43-42dd-9eb5-b2cfb146199f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:13.349065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74041047-1178-46cc-bf3a-5281dba06827 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:13.400731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2131b49-54ae-4bbc-93a5-c29dc0c1d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:13.401369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131b49-54ae-4bbc-93a5-c29dc0c1d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:13.401911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131b49-54ae-4bbc-93a5-c29dc0c1d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:13.402191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2131b49-54ae-4bbc-93a5-c29dc0c1d7d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:13.404432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2131b49-54ae-4bbc-93a5-c29dc0c1d7d1 None admin] RBAC: Adding query filter params (group.id=de0abe9219324d18831cd1fa62d42082, role.id=1067c35f1111496c983a6a7dec2a5ad9, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:13.404743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2131b49-54ae-4bbc-93a5-c29dc0c1d7d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:13.406250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b4609-fc43-42dd-9eb5-b2cfb146199f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:13.406676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2131b49-54ae-4bbc-93a5-c29dc0c1d7d1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:13.408998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b4609-fc43-42dd-9eb5-b2cfb146199f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:13.413869 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 185/375] 10.222.0.42 () {56 vars in 1376 bytes} [Fri May 27 13:39:13 2022] GET /identity/v3/role_assignments?group.id=de0abe9219324d18831cd1fa62d42082&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 260 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:13.414763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2131b49-54ae-4bbc-93a5-c29dc0c1d7d1 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:13.448282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:13.462137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:13.561529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 191/376] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:13.562734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9244-25e8-4cdf-8f47-3e892e2e2d8d None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:13.563053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9244-25e8-4cdf-8f47-3e892e2e2d8d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:13.563344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe9244-25e8-4cdf-8f47-3e892e2e2d8d None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:13.565089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 192/377] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:13.565390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2131b49-54ae-4bbc-93a5-c29dc0c1d7d1 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:13.575857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af9f9-6867-4b34-bc62-f44cb1f8f00b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:13.576623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af9f9-6867-4b34-bc62-f44cb1f8f00b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:13.577137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7af9f9-6867-4b34-bc62-f44cb1f8f00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:13.609686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-4a7af9f9-6867-4b34-bc62-f44cb1f8f00b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:13.611570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4a7af9f9-6867-4b34-bc62-f44cb1f8f00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:13.622380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b72102-b61a-4116-9408-88dfb7877f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:13.623549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72102-b61a-4116-9408-88dfb7877f1e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:13.623549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72102-b61a-4116-9408-88dfb7877f1e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:13.623744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b72102-b61a-4116-9408-88dfb7877f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:13.624462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b72102-b61a-4116-9408-88dfb7877f1e None admin] RBAC: Adding query filter params (group.id=de0abe9219324d18831cd1fa62d42082, role.id=a97f5aba7e1b4044b2c749cba5d5708f, scope.project.id=b3755fb9019c4a62a3376df0865a1020) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:13.624770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b72102-b61a-4116-9408-88dfb7877f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:13.626241 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b72102-b61a-4116-9408-88dfb7877f1e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:13.633249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 186/378] 10.222.0.42 () {56 vars in 1376 bytes} [Fri May 27 13:39:13 2022] GET /identity/v3/role_assignments?group.id=de0abe9219324d18831cd1fa62d42082&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=a97f5aba7e1b4044b2c749cba5d5708f => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:13.634098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b72102-b61a-4116-9408-88dfb7877f1e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:13.724928 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 193/379] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:13.764739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af9f9-6867-4b34-bc62-f44cb1f8f00b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:13.796922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:13.844917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b72102-b61a-4116-9408-88dfb7877f1e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:13.885520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:13.910505 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0168b-4ebb-46bf-b162-de5070b11632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:13.911959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0168b-4ebb-46bf-b162-de5070b11632 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:13.912768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0168b-4ebb-46bf-b162-de5070b11632 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:13.913273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0168b-4ebb-46bf-b162-de5070b11632 None admin] PATH_INFO: `/v3/projects/a72e15fb71aa4010bb48da49b133708a` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:13.914692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0168b-4ebb-46bf-b162-de5070b11632 None admin] RBAC: Authorizing `identity:get_project(project_id=a72e15fb71aa4010bb48da49b133708a)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:13.917161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c0168b-4ebb-46bf-b162-de5070b11632 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:13.921224 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 187/380] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:13 2022] GET /identity/v3/projects/a72e15fb71aa4010bb48da49b133708a => generated 344 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:13.928096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0168b-4ebb-46bf-b162-de5070b11632 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:13.941473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7af9f9-6867-4b34-bc62-f44cb1f8f00b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:13.985607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e08e-c159-4b19-bcca-5ac9218b9661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:13.986826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e08e-c159-4b19-bcca-5ac9218b9661 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:13.987365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e08e-c159-4b19-bcca-5ac9218b9661 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:13.987869 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61e08e-c159-4b19-bcca-5ac9218b9661 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:14.000433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61e08e-c159-4b19-bcca-5ac9218b9661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-3b61e08e-c159-4b19-bcca-5ac9218b9661 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:14.009042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:14.010125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:14.010954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:14.014310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 194/381] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:14.026635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e08e-c159-4b19-bcca-5ac9218b9661 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:14.060682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0168b-4ebb-46bf-b162-de5070b11632 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:14.131866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76380101-6dc7-4513-94d7-6e5b7b29f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:14.134511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76380101-6dc7-4513-94d7-6e5b7b29f27a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:14.135316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76380101-6dc7-4513-94d7-6e5b7b29f27a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:14.136062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76380101-6dc7-4513-94d7-6e5b7b29f27a None admin] PATH_INFO: `/v3/groups/8e2cb60b2f734bbc9be269e8f41f2a34` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:14.147826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76380101-6dc7-4513-94d7-6e5b7b29f27a None admin] RBAC: Authorizing `identity:get_group(group_id=8e2cb60b2f734bbc9be269e8f41f2a34)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:14.149594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76380101-6dc7-4513-94d7-6e5b7b29f27a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:14.153272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 188/382] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:13 2022] GET /identity/v3/groups/8e2cb60b2f734bbc9be269e8f41f2a34 => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:14.166411 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76380101-6dc7-4513-94d7-6e5b7b29f27a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:14.182441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61e08e-c159-4b19-bcca-5ac9218b9661 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:14.194288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:14.208183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:14.219807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d397ea6-663f-46ae-9876-7fb847b91258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:14.220476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d397ea6-663f-46ae-9876-7fb847b91258 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:14.220753 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d397ea6-663f-46ae-9876-7fb847b91258 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:14.221023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d397ea6-663f-46ae-9876-7fb847b91258 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:14.221764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d397ea6-663f-46ae-9876-7fb847b91258 None admin] RBAC: Adding query filter params (name=member) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:14.222114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d397ea6-663f-46ae-9876-7fb847b91258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:14.223568 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d397ea6-663f-46ae-9876-7fb847b91258 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:14.237737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 195/383] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:14.239093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d397ea6-663f-46ae-9876-7fb847b91258 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:14.327536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76380101-6dc7-4513-94d7-6e5b7b29f27a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:14.363696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372be8fd-59e5-42c4-85f2-1f8f745506c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:14.364600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be8fd-59e5-42c4-85f2-1f8f745506c6 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:14.365024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be8fd-59e5-42c4-85f2-1f8f745506c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:14.365437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372be8fd-59e5-42c4-85f2-1f8f745506c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:14.366412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372be8fd-59e5-42c4-85f2-1f8f745506c6 None admin] RBAC: Adding query filter params (group.id=8e2cb60b2f734bbc9be269e8f41f2a34, role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=a72e15fb71aa4010bb48da49b133708a) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:14.366891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372be8fd-59e5-42c4-85f2-1f8f745506c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:14.368488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372be8fd-59e5-42c4-85f2-1f8f745506c6 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:14.374771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 189/384] 10.222.0.42 () {56 vars in 1376 bytes} [Fri May 27 13:39:14 2022] GET /identity/v3/role_assignments?group.id=8e2cb60b2f734bbc9be269e8f41f2a34&scope.project.id=a72e15fb71aa4010bb48da49b133708a&role.id=3951cc86a51d416fafc5676d456e79ce => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:14.401013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d397ea6-663f-46ae-9876-7fb847b91258 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:14.438609 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf58305-133c-4bc2-a949-44e59da9ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:14.439791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf58305-133c-4bc2-a949-44e59da9ce64 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:14.440208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf58305-133c-4bc2-a949-44e59da9ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:14.440618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf58305-133c-4bc2-a949-44e59da9ce64 None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:14.441965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf58305-133c-4bc2-a949-44e59da9ce64 None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:14.443602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf58305-133c-4bc2-a949-44e59da9ce64 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:14.445679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 196/385] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:14 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:14.452049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372be8fd-59e5-42c4-85f2-1f8f745506c6 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:14.544078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:14.569810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372be8fd-59e5-42c4-85f2-1f8f745506c6 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:14.609147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f6cb9-123b-4aa4-b885-2ccfd6f14114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:14.610283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6cb9-123b-4aa4-b885-2ccfd6f14114 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:14.610708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6cb9-123b-4aa4-b885-2ccfd6f14114 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:14.611153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6cb9-123b-4aa4-b885-2ccfd6f14114 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:14.612478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f6cb9-123b-4aa4-b885-2ccfd6f14114 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:14.614087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f6cb9-123b-4aa4-b885-2ccfd6f14114 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:14.616259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 190/386] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:14 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:14.623990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf58305-133c-4bc2-a949-44e59da9ce64 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:14.693901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:14.752163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf58305-133c-4bc2-a949-44e59da9ce64 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:14.802386 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dd021-d132-4282-86d5-829b8284f6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:14.803295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd021-d132-4282-86d5-829b8284f6e6 None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:14.803575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd021-d132-4282-86d5-829b8284f6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:14.803846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dd021-d132-4282-86d5-829b8284f6e6 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020/groups/de0abe9219324d18831cd1fa62d42082/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:14.808054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dd021-d132-4282-86d5-829b8284f6e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3755fb9019c4a62a3376df0865a1020, group_id=de0abe9219324d18831cd1fa62d42082, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:14.809541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603dd021-d132-4282-86d5-829b8284f6e6 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:14.892075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 197/387] 10.222.0.42 () {58 vars in 1442 bytes} [Fri May 27 13:39:14 2022] PUT /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020/groups/de0abe9219324d18831cd1fa62d42082/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:16.062245 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb2ab-ae51-4eb9-8830-719e69ecc489 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.063324 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb2ab-ae51-4eb9-8830-719e69ecc489 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.063838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb2ab-ae51-4eb9-8830-719e69ecc489 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.065846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 191/388] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:16.071334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01989a6d-51b8-4e45-a421-0f4b1b2d04b4 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.071809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01989a6d-51b8-4e45-a421-0f4b1b2d04b4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.072023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01989a6d-51b8-4e45-a421-0f4b1b2d04b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.094086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-01989a6d-51b8-4e45-a421-0f4b1b2d04b4 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:16.095301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-01989a6d-51b8-4e45-a421-0f4b1b2d04b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:16.109950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df919-90f0-4ef9-88ca-bf6bb0711d20 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.110259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df919-90f0-4ef9-88ca-bf6bb0711d20 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.110520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9df919-90f0-4ef9-88ca-bf6bb0711d20 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.112344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 192/389] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:16.132887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09c9e-db63-4cbc-88e9-bcb648f56869 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.133200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09c9e-db63-4cbc-88e9-bcb648f56869 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.133445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09c9e-db63-4cbc-88e9-bcb648f56869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.167177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-d2e09c9e-db63-4cbc-88e9-bcb648f56869 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:16.168389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d2e09c9e-db63-4cbc-88e9-bcb648f56869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:16.183974 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 198/390] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:16.222352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01989a6d-51b8-4e45-a421-0f4b1b2d04b4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:16.279140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:16.281733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 193/391] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:16.320128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e09c9e-db63-4cbc-88e9-bcb648f56869 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:16.341848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01989a6d-51b8-4e45-a421-0f4b1b2d04b4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:16.378999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0760-cdd7-4b15-9fe7-83f16503e58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:16.379825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0760-cdd7-4b15-9fe7-83f16503e58c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.380219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0760-cdd7-4b15-9fe7-83f16503e58c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.380492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0760-cdd7-4b15-9fe7-83f16503e58c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.392151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0760-cdd7-4b15-9fe7-83f16503e58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-604c0760-cdd7-4b15-9fe7-83f16503e58c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:16.400595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:16.401508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:16.402290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 199/392] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:39:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:16.408545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871dbe9-4ea8-41ea-8968-4299bf561786 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.408832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871dbe9-4ea8-41ea-8968-4299bf561786 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.409104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871dbe9-4ea8-41ea-8968-4299bf561786 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.412066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 200/393] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:16.415527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871dbe9-4ea8-41ea-8968-4299bf561786 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:16.424517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:16.458608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e09c9e-db63-4cbc-88e9-bcb648f56869 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:16.506046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecf7dc-2435-4fa0-8eb3-5030b8c96b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:16.507692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecf7dc-2435-4fa0-8eb3-5030b8c96b57 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.508202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecf7dc-2435-4fa0-8eb3-5030b8c96b57 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.508655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecf7dc-2435-4fa0-8eb3-5030b8c96b57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.524709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecf7dc-2435-4fa0-8eb3-5030b8c96b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:16.536461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871dbe9-4ea8-41ea-8968-4299bf561786 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-41ecf7dc-2435-4fa0-8eb3-5030b8c96b57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:16.536717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:16.537684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:16.538478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:16.546359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 194/394] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:16.546359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6728a-d542-41e1-89b0-eb9169233648 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.546359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6728a-d542-41e1-89b0-eb9169233648 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.546359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6728a-d542-41e1-89b0-eb9169233648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.547291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:16.570558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-45b6728a-d542-41e1-89b0-eb9169233648 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:16.572622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-45b6728a-d542-41e1-89b0-eb9169233648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:16.584444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d000-6620-4f24-ab4c-8e6eeb53c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:16.585161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d000-6620-4f24-ab4c-8e6eeb53c925 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.585441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d000-6620-4f24-ab4c-8e6eeb53c925 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.585718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2d000-6620-4f24-ab4c-8e6eeb53c925 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.587024 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2d000-6620-4f24-ab4c-8e6eeb53c925 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:16.587342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2d000-6620-4f24-ab4c-8e6eeb53c925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:16.589137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2d000-6620-4f24-ab4c-8e6eeb53c925 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:16.603050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 201/395] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:16.604207 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d000-6620-4f24-ab4c-8e6eeb53c925 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:16.681218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 195/396] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:16.681757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6728a-d542-41e1-89b0-eb9169233648 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:16.734331 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2d000-6620-4f24-ab4c-8e6eeb53c925 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:16.751002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:16.770473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245714-9d7d-414e-9bea-e0216dedf08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:16.771521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245714-9d7d-414e-9bea-e0216dedf08d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.772031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245714-9d7d-414e-9bea-e0216dedf08d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.772499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245714-9d7d-414e-9bea-e0216dedf08d None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.773439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64245714-9d7d-414e-9bea-e0216dedf08d None admin] RBAC: Adding query filter params (name=member) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:16.773940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64245714-9d7d-414e-9bea-e0216dedf08d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:16.775544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64245714-9d7d-414e-9bea-e0216dedf08d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:16.785132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 202/397] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:16.786233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245714-9d7d-414e-9bea-e0216dedf08d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:16.800444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6728a-d542-41e1-89b0-eb9169233648 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:16.817056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:16.838458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10380bd9-a995-404b-8f07-7f14884f92bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:16.839274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10380bd9-a995-404b-8f07-7f14884f92bc None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.839562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10380bd9-a995-404b-8f07-7f14884f92bc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.839899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10380bd9-a995-404b-8f07-7f14884f92bc None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.841758 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10380bd9-a995-404b-8f07-7f14884f92bc None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:16.843290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10380bd9-a995-404b-8f07-7f14884f92bc None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:16.849698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 196/398] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:16 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:16.850538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10380bd9-a995-404b-8f07-7f14884f92bc None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:16.895122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245714-9d7d-414e-9bea-e0216dedf08d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:16.931897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11749b69-d2cf-4987-af9b-621f2e6a011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:16.933085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749b69-d2cf-4987-af9b-621f2e6a011d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:16.933591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749b69-d2cf-4987-af9b-621f2e6a011d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:16.934060 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11749b69-d2cf-4987-af9b-621f2e6a011d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:16.944934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11749b69-d2cf-4987-af9b-621f2e6a011d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-11749b69-d2cf-4987-af9b-621f2e6a011d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:16.953955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:16.954839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:16.955639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:16.958363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 203/399] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:39:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:16.959386 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11749b69-d2cf-4987-af9b-621f2e6a011d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:16.961552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10380bd9-a995-404b-8f07-7f14884f92bc None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:16.995840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:17.002944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3466f1-2977-405c-8210-059289d7da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:17.003903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3466f1-2977-405c-8210-059289d7da8f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.004187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3466f1-2977-405c-8210-059289d7da8f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.004463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3466f1-2977-405c-8210-059289d7da8f None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.005804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3466f1-2977-405c-8210-059289d7da8f None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:17.007382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3466f1-2977-405c-8210-059289d7da8f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:17.014633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 197/400] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:16 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:17.015694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3466f1-2977-405c-8210-059289d7da8f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:17.062897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:17.076396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11749b69-d2cf-4987-af9b-621f2e6a011d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:17.113280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d4150-4e3c-4e43-9c47-aafc16edfb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:17.114471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d4150-4e3c-4e43-9c47-aafc16edfb9a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.115033 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d4150-4e3c-4e43-9c47-aafc16edfb9a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.115509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d4150-4e3c-4e43-9c47-aafc16edfb9a None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.116970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d4150-4e3c-4e43-9c47-aafc16edfb9a None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:17.118601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d4150-4e3c-4e43-9c47-aafc16edfb9a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:17.120823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 204/401] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:16 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:17.121927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d4150-4e3c-4e43-9c47-aafc16edfb9a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:17.133822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3466f1-2977-405c-8210-059289d7da8f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:17.177575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc57ffe-b53a-419a-9b1b-6e3dc869dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:17.178906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc57ffe-b53a-419a-9b1b-6e3dc869dd6f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.179394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc57ffe-b53a-419a-9b1b-6e3dc869dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.181427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc57ffe-b53a-419a-9b1b-6e3dc869dd6f None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.181427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc57ffe-b53a-419a-9b1b-6e3dc869dd6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:17.181733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc57ffe-b53a-419a-9b1b-6e3dc869dd6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:17.183616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc57ffe-b53a-419a-9b1b-6e3dc869dd6f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:17.193938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 198/402] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:17.195057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc57ffe-b53a-419a-9b1b-6e3dc869dd6f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:17.235723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d4150-4e3c-4e43-9c47-aafc16edfb9a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:17.262551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:17.271853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b31091-05a0-43c0-ae8d-b2a326fe0c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:17.272734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31091-05a0-43c0-ae8d-b2a326fe0c35 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.273018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31091-05a0-43c0-ae8d-b2a326fe0c35 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.273297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31091-05a0-43c0-ae8d-b2a326fe0c35 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.274475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b31091-05a0-43c0-ae8d-b2a326fe0c35 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:17.275942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b31091-05a0-43c0-ae8d-b2a326fe0c35 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:17.282499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 205/403] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:17 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:17.282499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a43e6-9e17-4e86-9eb8-36f1a203c901 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.282499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a43e6-9e17-4e86-9eb8-36f1a203c901 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.282499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a43e6-9e17-4e86-9eb8-36f1a203c901 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.282499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 206/404] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:17.282889 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a43e6-9e17-4e86-9eb8-36f1a203c901 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:17.315273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:17.318917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc57ffe-b53a-419a-9b1b-6e3dc869dd6f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:17.357457 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc830bf-b4ee-4dfd-9e42-687ba030f1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:17.358716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc830bf-b4ee-4dfd-9e42-687ba030f1e6 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.359299 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc830bf-b4ee-4dfd-9e42-687ba030f1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.359912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc830bf-b4ee-4dfd-9e42-687ba030f1e6 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/groups/de0abe9219324d18831cd1fa62d42082/roles/a97f5aba7e1b4044b2c749cba5d5708f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.362550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc830bf-b4ee-4dfd-9e42-687ba030f1e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8cb39fe7bad426e9aac2872667c1a1c, group_id=de0abe9219324d18831cd1fa62d42082, role_id=a97f5aba7e1b4044b2c749cba5d5708f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:17.364417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc830bf-b4ee-4dfd-9e42-687ba030f1e6 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:17.400093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a43e6-9e17-4e86-9eb8-36f1a203c901 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:17.436421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44630bf3-558f-438e-bfbc-b78e197b2cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:17.437385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630bf3-558f-438e-bfbc-b78e197b2cf9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.437822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630bf3-558f-438e-bfbc-b78e197b2cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.438053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630bf3-558f-438e-bfbc-b78e197b2cf9 None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.439366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44630bf3-558f-438e-bfbc-b78e197b2cf9 None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:17.440902 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44630bf3-558f-438e-bfbc-b78e197b2cf9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:17.442733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 199/405] 10.222.0.42 () {58 vars in 1442 bytes} [Fri May 27 13:39:17 2022] PUT /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/groups/de0abe9219324d18831cd1fa62d42082/roles/a97f5aba7e1b4044b2c749cba5d5708f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:17.442852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 207/406] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:17 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:17.452106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac6c79-d241-41ea-9e3d-d0c9bb627895 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.452106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac6c79-d241-41ea-9e3d-d0c9bb627895 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.452106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac6c79-d241-41ea-9e3d-d0c9bb627895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.452422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc830bf-b4ee-4dfd-9e42-687ba030f1e6 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:17.480228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0aac6c79-d241-41ea-9e3d-d0c9bb627895 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:17.481491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0aac6c79-d241-41ea-9e3d-d0c9bb627895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:17.604593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc830bf-b4ee-4dfd-9e42-687ba030f1e6 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:17.635008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:17.650335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c628b-816d-4622-a90e-9c20ed2b583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:17.651742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c628b-816d-4622-a90e-9c20ed2b583a None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.652261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c628b-816d-4622-a90e-9c20ed2b583a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.652737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c628b-816d-4622-a90e-9c20ed2b583a None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/groups/de0abe9219324d18831cd1fa62d42082/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.655231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c628b-816d-4622-a90e-9c20ed2b583a None admin] RBAC: Authorizing `identity:create_grant(project_id=c8cb39fe7bad426e9aac2872667c1a1c, group_id=de0abe9219324d18831cd1fa62d42082, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:17.657024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c628b-816d-4622-a90e-9c20ed2b583a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:17.663154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 208/407] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:17.666321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac6c79-d241-41ea-9e3d-d0c9bb627895 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:17.699176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:17.762540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 200/408] 10.222.0.42 () {58 vars in 1442 bytes} [Fri May 27 13:39:17 2022] PUT /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c/groups/de0abe9219324d18831cd1fa62d42082/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:17.763689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c628b-816d-4622-a90e-9c20ed2b583a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:17.809389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac6c79-d241-41ea-9e3d-d0c9bb627895 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:17.862067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176dfd0-3fde-4f5a-a168-465507dd6984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:17.863232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176dfd0-3fde-4f5a-a168-465507dd6984 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.863655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176dfd0-3fde-4f5a-a168-465507dd6984 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.864066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176dfd0-3fde-4f5a-a168-465507dd6984 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.865516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176dfd0-3fde-4f5a-a168-465507dd6984 None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:17.867782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176dfd0-3fde-4f5a-a168-465507dd6984 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:17.875247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 209/409] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:17 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:17.877159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8ac6-2050-4cc5-8b0d-2510214a1835 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.877494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8ac6-2050-4cc5-8b0d-2510214a1835 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.877760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8ac6-2050-4cc5-8b0d-2510214a1835 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.881282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 210/410] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:17.882692 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe8ac6-2050-4cc5-8b0d-2510214a1835 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:17.902002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c628b-816d-4622-a90e-9c20ed2b583a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:17.941535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f01d8-aaac-4c6c-a468-03c3b5bf6acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:17.942708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f01d8-aaac-4c6c-a468-03c3b5bf6acf None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.942708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f01d8-aaac-4c6c-a468-03c3b5bf6acf None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.943023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f01d8-aaac-4c6c-a468-03c3b5bf6acf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.956028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f01d8-aaac-4c6c-a468-03c3b5bf6acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-799f01d8-aaac-4c6c-a468-03c3b5bf6acf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:17.965075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:17.967285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:17.968098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 201/411] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:39:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:17.969234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052119-fe5d-464c-b77f-850738c70e0b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:17.969234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052119-fe5d-464c-b77f-850738c70e0b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:17.969524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a052119-fe5d-464c-b77f-850738c70e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:17.988272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-1a052119-fe5d-464c-b77f-850738c70e0b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:17.989476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1a052119-fe5d-464c-b77f-850738c70e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:18.002486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:18.017961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe8ac6-2050-4cc5-8b0d-2510214a1835 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:18.040712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:18.057839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0afe43-5507-4622-98cb-0c0b86f72e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:18.058778 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0afe43-5507-4622-98cb-0c0b86f72e65 None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:18.059101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0afe43-5507-4622-98cb-0c0b86f72e65 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:18.060260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0afe43-5507-4622-98cb-0c0b86f72e65 None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020/groups/de0abe9219324d18831cd1fa62d42082/roles/a97f5aba7e1b4044b2c749cba5d5708f` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:18.062893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0afe43-5507-4622-98cb-0c0b86f72e65 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3755fb9019c4a62a3376df0865a1020, group_id=de0abe9219324d18831cd1fa62d42082, role_id=a97f5aba7e1b4044b2c749cba5d5708f)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:18.064449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0afe43-5507-4622-98cb-0c0b86f72e65 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:18.081127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 202/412] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:18.082270 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052119-fe5d-464c-b77f-850738c70e0b None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:18.188709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a052119-fe5d-464c-b77f-850738c70e0b None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:18.202119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 211/413] 10.222.0.42 () {58 vars in 1442 bytes} [Fri May 27 13:39:17 2022] PUT /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020/groups/de0abe9219324d18831cd1fa62d42082/roles/a97f5aba7e1b4044b2c749cba5d5708f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:18.208473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0afe43-5507-4622-98cb-0c0b86f72e65 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:18.273402 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85558898-62e2-4652-9311-29b227470360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:18.274110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85558898-62e2-4652-9311-29b227470360 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:18.274397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85558898-62e2-4652-9311-29b227470360 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:18.274680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85558898-62e2-4652-9311-29b227470360 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:18.275502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85558898-62e2-4652-9311-29b227470360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:18.275816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85558898-62e2-4652-9311-29b227470360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:18.277278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85558898-62e2-4652-9311-29b227470360 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:18.298861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 203/414] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:18.304796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85558898-62e2-4652-9311-29b227470360 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:18.349401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0afe43-5507-4622-98cb-0c0b86f72e65 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:18.395903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25614837-e0f6-4888-b41c-f6813cfdb650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:18.397175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25614837-e0f6-4888-b41c-f6813cfdb650 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:18.397711 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25614837-e0f6-4888-b41c-f6813cfdb650 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:18.398213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25614837-e0f6-4888-b41c-f6813cfdb650 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:18.405945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:18.415476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25614837-e0f6-4888-b41c-f6813cfdb650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-25614837-e0f6-4888-b41c-f6813cfdb650 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:18.424313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:18.425401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:18.426353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:18.428445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 212/415] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:18.434344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25614837-e0f6-4888-b41c-f6813cfdb650 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:18.448182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:18.518674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85558898-62e2-4652-9311-29b227470360 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:18.546667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25614837-e0f6-4888-b41c-f6813cfdb650 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:18.563334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca290b75-a343-41d6-b769-410f1d2d1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:18.564884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca290b75-a343-41d6-b769-410f1d2d1f32 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:18.565316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca290b75-a343-41d6-b769-410f1d2d1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:18.565764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca290b75-a343-41d6-b769-410f1d2d1f32 None admin] PATH_INFO: `/v3/groups/8e2cb60b2f734bbc9be269e8f41f2a34` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:18.567144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca290b75-a343-41d6-b769-410f1d2d1f32 None admin] RBAC: Authorizing `identity:get_group(group_id=8e2cb60b2f734bbc9be269e8f41f2a34)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:18.569544 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca290b75-a343-41d6-b769-410f1d2d1f32 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:18.572165 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 204/416] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:18 2022] GET /identity/v3/groups/8e2cb60b2f734bbc9be269e8f41f2a34 => generated 229 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:18.578646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca290b75-a343-41d6-b769-410f1d2d1f32 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:18.588617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4e010-15a0-49c4-afcc-22b81e491623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:18.589289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e010-15a0-49c4-afcc-22b81e491623 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:18.591475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e010-15a0-49c4-afcc-22b81e491623 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:18.591475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e010-15a0-49c4-afcc-22b81e491623 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:18.591475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4e010-15a0-49c4-afcc-22b81e491623 None admin] RBAC: Adding query filter params (name=member) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:18.591787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4e010-15a0-49c4-afcc-22b81e491623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:18.593674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4e010-15a0-49c4-afcc-22b81e491623 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:18.606118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 213/417] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:18.615347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4e010-15a0-49c4-afcc-22b81e491623 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:18.753187 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:18.767031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca290b75-a343-41d6-b769-410f1d2d1f32 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:18.768649 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:18.785840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4e010-15a0-49c4-afcc-22b81e491623 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:18.812650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31e26a-121c-4bee-8600-063d682471da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:18.813526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31e26a-121c-4bee-8600-063d682471da None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:18.813810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31e26a-121c-4bee-8600-063d682471da None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:18.814089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31e26a-121c-4bee-8600-063d682471da None admin] PATH_INFO: `/v3/projects/a72e15fb71aa4010bb48da49b133708a` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:18.815443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31e26a-121c-4bee-8600-063d682471da None admin] RBAC: Authorizing `identity:get_project(project_id=a72e15fb71aa4010bb48da49b133708a)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:18.816871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31e26a-121c-4bee-8600-063d682471da None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:18.818956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 205/418] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:18 2022] GET /identity/v3/projects/a72e15fb71aa4010bb48da49b133708a => generated 344 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:18.826123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31e26a-121c-4bee-8600-063d682471da None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:18.831558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad1a61-0bb8-4bf8-b3ed-1dff230a4b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:18.832702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1a61-0bb8-4bf8-b3ed-1dff230a4b0e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:18.833446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1a61-0bb8-4bf8-b3ed-1dff230a4b0e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:18.833915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1a61-0bb8-4bf8-b3ed-1dff230a4b0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:18.906065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad1a61-0bb8-4bf8-b3ed-1dff230a4b0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:18.907897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad1a61-0bb8-4bf8-b3ed-1dff230a4b0e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:18.969629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31e26a-121c-4bee-8600-063d682471da None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:18.980293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:19.009197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b8e47-c930-4bfd-a8ae-f748e68fa991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:19.009197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b8e47-c930-4bfd-a8ae-f748e68fa991 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:19.009197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b8e47-c930-4bfd-a8ae-f748e68fa991 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:19.009197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b8e47-c930-4bfd-a8ae-f748e68fa991 None admin] PATH_INFO: `/v3/projects/a72e15fb71aa4010bb48da49b133708a/groups/8e2cb60b2f734bbc9be269e8f41f2a34/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:19.009582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b8e47-c930-4bfd-a8ae-f748e68fa991 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72e15fb71aa4010bb48da49b133708a, group_id=8e2cb60b2f734bbc9be269e8f41f2a34, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:19.010708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b8e47-c930-4bfd-a8ae-f748e68fa991 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:19.014618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 214/419] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 13:39:19.020244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad1a61-0bb8-4bf8-b3ed-1dff230a4b0e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:19.112499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 206/420] 10.222.0.42 () {58 vars in 1442 bytes} [Fri May 27 13:39:18 2022] PUT /identity/v3/projects/a72e15fb71aa4010bb48da49b133708a/groups/8e2cb60b2f734bbc9be269e8f41f2a34/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 13:39:19.141160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad1a61-0bb8-4bf8-b3ed-1dff230a4b0e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:19.183032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b552b-569e-4b3c-b886-2f551c4fbbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:19.184347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b552b-569e-4b3c-b886-2f551c4fbbde None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:19.184884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b552b-569e-4b3c-b886-2f551c4fbbde None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:19.185354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b552b-569e-4b3c-b886-2f551c4fbbde None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:19.186852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b552b-569e-4b3c-b886-2f551c4fbbde None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:19.188629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b552b-569e-4b3c-b886-2f551c4fbbde None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:19.191087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 215/421] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:19 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:19.196663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b8e47-c930-4bfd-a8ae-f748e68fa991 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:19.237222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:19.316875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b8e47-c930-4bfd-a8ae-f748e68fa991 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:19.353248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e6ea0-be48-4f77-9305-2d982779559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:19.354164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e6ea0-be48-4f77-9305-2d982779559e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:19.354441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e6ea0-be48-4f77-9305-2d982779559e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:19.354805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e6ea0-be48-4f77-9305-2d982779559e None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:19.356720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e6ea0-be48-4f77-9305-2d982779559e None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:19.358372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e6ea0-be48-4f77-9305-2d982779559e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:19.360352 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 207/422] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:19 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:19.368060 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b552b-569e-4b3c-b886-2f551c4fbbde None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:19.419802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:19.494626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b552b-569e-4b3c-b886-2f551c4fbbde None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:19.538452 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f5c2a-b35e-401b-aae4-d5ceb0a1074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:19.539518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f5c2a-b35e-401b-aae4-d5ceb0a1074f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:19.540018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f5c2a-b35e-401b-aae4-d5ceb0a1074f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:19.541621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f5c2a-b35e-401b-aae4-d5ceb0a1074f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:19.542657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f5c2a-b35e-401b-aae4-d5ceb0a1074f None admin] RBAC: Adding query filter params (group.id=de0abe9219324d18831cd1fa62d42082, role.id=1067c35f1111496c983a6a7dec2a5ad9, scope.project.id=b3755fb9019c4a62a3376df0865a1020) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:19.543192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f5c2a-b35e-401b-aae4-d5ceb0a1074f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:19.545369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f5c2a-b35e-401b-aae4-d5ceb0a1074f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:19.558311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 216/423] 10.222.0.42 () {56 vars in 1376 bytes} [Fri May 27 13:39:19 2022] GET /identity/v3/role_assignments?group.id=de0abe9219324d18831cd1fa62d42082&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:20.023353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ae9d4-6d98-4d46-8784-2901ca669480 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:20.024090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ae9d4-6d98-4d46-8784-2901ca669480 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:20.024597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ae9d4-6d98-4d46-8784-2901ca669480 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:20.026317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 208/424] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:20.032422 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e82a9-b6b4-4d1b-b827-f9bd05301a33 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:20.032951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e82a9-b6b4-4d1b-b827-f9bd05301a33 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:20.033425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e82a9-b6b4-4d1b-b827-f9bd05301a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:20.051885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-956e82a9-b6b4-4d1b-b827-f9bd05301a33 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:20.053426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-956e82a9-b6b4-4d1b-b827-f9bd05301a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:20.131406 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 217/425] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:20.157320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ae9d4-6d98-4d46-8784-2901ca669480 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:20.267160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:20.272768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ae9d4-6d98-4d46-8784-2901ca669480 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:20.311034 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe4260-a47c-42c9-aff8-5c1a09c2bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:20.312166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4260-a47c-42c9-aff8-5c1a09c2bd7d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:20.312717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4260-a47c-42c9-aff8-5c1a09c2bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:20.313193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe4260-a47c-42c9-aff8-5c1a09c2bd7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:20.324705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe4260-a47c-42c9-aff8-5c1a09c2bd7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-0afe4260-a47c-42c9-aff8-5c1a09c2bd7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:20.333123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:20.333985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:20.334771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:20.337450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 209/426] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:39:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:20.343978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e82a9-b6b4-4d1b-b827-f9bd05301a33 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:20.378511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f619493-d198-42ad-b198-06f455347f1e None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:20.379296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f619493-d198-42ad-b198-06f455347f1e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:20.379797 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f619493-d198-42ad-b198-06f455347f1e None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:20.381372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:20.381827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 210/427] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:20.394321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166ac87-199c-4a3f-b321-5e3d3571340e None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:20.394595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166ac87-199c-4a3f-b321-5e3d3571340e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:20.394869 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166ac87-199c-4a3f-b321-5e3d3571340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:20.419309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-e166ac87-199c-4a3f-b321-5e3d3571340e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:20.420755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e166ac87-199c-4a3f-b321-5e3d3571340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:20.460201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e82a9-b6b4-4d1b-b827-f9bd05301a33 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:20.498523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac380-e00d-479c-ac23-0f3e5cf4e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:20.499226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac380-e00d-479c-ac23-0f3e5cf4e0db None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:20.499511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac380-e00d-479c-ac23-0f3e5cf4e0db None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:20.499786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac380-e00d-479c-ac23-0f3e5cf4e0db None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:20.500534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac380-e00d-479c-ac23-0f3e5cf4e0db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:20.500969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac380-e00d-479c-ac23-0f3e5cf4e0db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:20.502154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 211/428] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:20.502330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac380-e00d-479c-ac23-0f3e5cf4e0db None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:20.521248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 218/429] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:20.526872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166ac87-199c-4a3f-b321-5e3d3571340e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:20.541543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac380-e00d-479c-ac23-0f3e5cf4e0db None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:20.643518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:20.658011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166ac87-199c-4a3f-b321-5e3d3571340e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:20.677450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:20.684256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac380-e00d-479c-ac23-0f3e5cf4e0db None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:20.698265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024b941-ce96-4b42-92ae-16ec69938149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:20.701659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024b941-ce96-4b42-92ae-16ec69938149 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:20.702189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024b941-ce96-4b42-92ae-16ec69938149 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:20.702645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024b941-ce96-4b42-92ae-16ec69938149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:20.726723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4487847-5cdd-4178-85f1-b921d5e78b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:20.727556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4487847-5cdd-4178-85f1-b921d5e78b87 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:20.727844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4487847-5cdd-4178-85f1-b921d5e78b87 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:20.728120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4487847-5cdd-4178-85f1-b921d5e78b87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:20.741688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4487847-5cdd-4178-85f1-b921d5e78b87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-d4487847-5cdd-4178-85f1-b921d5e78b87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:20.750367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:20.751347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 13:39:20.752129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:20.752722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 219/430] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:20.758723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4487847-5cdd-4178-85f1-b921d5e78b87 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:20.805142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024b941-ce96-4b42-92ae-16ec69938149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:20.806990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024b941-ce96-4b42-92ae-16ec69938149 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:20.886098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4487847-5cdd-4178-85f1-b921d5e78b87 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:20.922021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:20.933821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c027287-cc7d-4c88-adfd-5d2a029a691e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:20.935841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c027287-cc7d-4c88-adfd-5d2a029a691e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:20.936212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 212/431] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:20.939904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c027287-cc7d-4c88-adfd-5d2a029a691e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:20.939904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c027287-cc7d-4c88-adfd-5d2a029a691e None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:20.939904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c027287-cc7d-4c88-adfd-5d2a029a691e None admin] RBAC: Adding query filter params (name=member) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:20.939904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c027287-cc7d-4c88-adfd-5d2a029a691e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:20.939904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c027287-cc7d-4c88-adfd-5d2a029a691e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:20.941546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024b941-ce96-4b42-92ae-16ec69938149 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:20.950571 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 220/432] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:39:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:20.955986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c027287-cc7d-4c88-adfd-5d2a029a691e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:20.985468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:21.063880 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024b941-ce96-4b42-92ae-16ec69938149 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:21.098648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c027287-cc7d-4c88-adfd-5d2a029a691e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:21.104312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9384be-baa5-48d9-b721-442118a81174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:21.105181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9384be-baa5-48d9-b721-442118a81174 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.105472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9384be-baa5-48d9-b721-442118a81174 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.105733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9384be-baa5-48d9-b721-442118a81174 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.107257 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9384be-baa5-48d9-b721-442118a81174 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:21.108725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9384be-baa5-48d9-b721-442118a81174 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:21.111342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 213/433] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:20 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:21.116675 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9384be-baa5-48d9-b721-442118a81174 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:21.149492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bffe2-5ca1-4834-a89c-f20d87d79043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:21.151098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bffe2-5ca1-4834-a89c-f20d87d79043 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.151728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bffe2-5ca1-4834-a89c-f20d87d79043 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.152255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bffe2-5ca1-4834-a89c-f20d87d79043 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.182095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:21.227107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9384be-baa5-48d9-b721-442118a81174 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:21.232143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bffe2-5ca1-4834-a89c-f20d87d79043 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:21.233611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bffe2-5ca1-4834-a89c-f20d87d79043 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:21.253813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:21.264516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed00407-0c45-46e3-a959-97174518d7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:21.265385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed00407-0c45-46e3-a959-97174518d7a1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.265724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed00407-0c45-46e3-a959-97174518d7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.266003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed00407-0c45-46e3-a959-97174518d7a1 None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.269094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed00407-0c45-46e3-a959-97174518d7a1 None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:21.269094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed00407-0c45-46e3-a959-97174518d7a1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:21.270387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 214/434] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:21 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:21.273313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778c4e-5a70-44fd-8d37-95491e722238 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.273729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778c4e-5a70-44fd-8d37-95491e722238 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.274121 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4778c4e-5a70-44fd-8d37-95491e722238 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.275657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 215/435] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:21.276545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4778c4e-5a70-44fd-8d37-95491e722238 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:21.349265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 221/436] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 13:39:21.350780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d218f-4324-4b8f-913d-686561f0ac8f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.351278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d218f-4324-4b8f-913d-686561f0ac8f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.351715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d218f-4324-4b8f-913d-686561f0ac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.370324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7c4d218f-4324-4b8f-913d-686561f0ac8f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:21.371607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7c4d218f-4324-4b8f-913d-686561f0ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:21.391944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4778c4e-5a70-44fd-8d37-95491e722238 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:21.419898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:21.430627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4de20a-e983-4ec0-ab21-61741c3178e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:21.431533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4de20a-e983-4ec0-ab21-61741c3178e2 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.431820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4de20a-e983-4ec0-ab21-61741c3178e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.432158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4de20a-e983-4ec0-ab21-61741c3178e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.432960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4de20a-e983-4ec0-ab21-61741c3178e2 None admin] RBAC: Adding query filter params (group.id=de0abe9219324d18831cd1fa62d42082, role.id=a97f5aba7e1b4044b2c749cba5d5708f, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:21.433277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4de20a-e983-4ec0-ab21-61741c3178e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:21.435363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4de20a-e983-4ec0-ab21-61741c3178e2 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:21.441906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 216/437] 10.222.0.42 () {56 vars in 1376 bytes} [Fri May 27 13:39:21 2022] GET /identity/v3/role_assignments?group.id=de0abe9219324d18831cd1fa62d42082&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=a97f5aba7e1b4044b2c749cba5d5708f => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:21.442774 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4de20a-e983-4ec0-ab21-61741c3178e2 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:21.459201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 222/438] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:21.494799 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d218f-4324-4b8f-913d-686561f0ac8f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:21.566857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:21.582375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4de20a-e983-4ec0-ab21-61741c3178e2 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:21.624394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff4d4-00ab-40bc-8b5f-bc74647c5089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:21.625470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff4d4-00ab-40bc-8b5f-bc74647c5089 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.625858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff4d4-00ab-40bc-8b5f-bc74647c5089 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.626240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff4d4-00ab-40bc-8b5f-bc74647c5089 None admin] PATH_INFO: `/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.627915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff4d4-00ab-40bc-8b5f-bc74647c5089 None admin] RBAC: Authorizing `identity:get_project(project_id=c8cb39fe7bad426e9aac2872667c1a1c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:21.629408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff4d4-00ab-40bc-8b5f-bc74647c5089 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:21.631699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 217/439] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:21 2022] GET /identity/v3/projects/c8cb39fe7bad426e9aac2872667c1a1c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:21.637054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d218f-4324-4b8f-913d-686561f0ac8f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:21.640319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff4d4-00ab-40bc-8b5f-bc74647c5089 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:21.682532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb7d19-3812-460c-a69c-6b8c39fe4e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:21.683715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb7d19-3812-460c-a69c-6b8c39fe4e83 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.683715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb7d19-3812-460c-a69c-6b8c39fe4e83 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.683899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb7d19-3812-460c-a69c-6b8c39fe4e83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.694865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb7d19-3812-460c-a69c-6b8c39fe4e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-57eb7d19-3812-460c-a69c-6b8c39fe4e83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:21.704031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:21.705026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:21.705986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:21.707321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:21.708194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 223/440] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:39:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:21.709570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d7a59-3632-465b-a48c-25dff765e1c6 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.710006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d7a59-3632-465b-a48c-25dff765e1c6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.710279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d7a59-3632-465b-a48c-25dff765e1c6 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.711561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 224/441] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:21.713700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d7a59-3632-465b-a48c-25dff765e1c6 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:21.757904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff4d4-00ab-40bc-8b5f-bc74647c5089 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:21.791941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfe0e7-4861-461b-ad3f-19edb94fb576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:21.792798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfe0e7-4861-461b-ad3f-19edb94fb576 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.793080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfe0e7-4861-461b-ad3f-19edb94fb576 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.793359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfe0e7-4861-461b-ad3f-19edb94fb576 None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.794641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfe0e7-4861-461b-ad3f-19edb94fb576 None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:21.796127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfe0e7-4861-461b-ad3f-19edb94fb576 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:21.797911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 218/442] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:21 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:21.799152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d2c6-e7da-425f-9768-ca9c02c394a6 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.799434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d2c6-e7da-425f-9768-ca9c02c394a6 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.799709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d2c6-e7da-425f-9768-ca9c02c394a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.816115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a764d2c6-e7da-425f-9768-ca9c02c394a6 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:21.817306 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a764d2c6-e7da-425f-9768-ca9c02c394a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:21.821881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d7a59-3632-465b-a48c-25dff765e1c6 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:21.831289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:21.855453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80ec38-361c-49cb-a2eb-ff4f77367084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:21.856871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80ec38-361c-49cb-a2eb-ff4f77367084 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:21.857167 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80ec38-361c-49cb-a2eb-ff4f77367084 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:21.857443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80ec38-361c-49cb-a2eb-ff4f77367084 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:21.858186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80ec38-361c-49cb-a2eb-ff4f77367084 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:21.858501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80ec38-361c-49cb-a2eb-ff4f77367084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:21.860033 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c80ec38-361c-49cb-a2eb-ff4f77367084 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:21.868468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 225/443] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:21.869440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80ec38-361c-49cb-a2eb-ff4f77367084 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:21.884697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 219/444] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:21.885532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d2c6-e7da-425f-9768-ca9c02c394a6 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:21.942937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:21.970507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c80ec38-361c-49cb-a2eb-ff4f77367084 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:21.988127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d2c6-e7da-425f-9768-ca9c02c394a6 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:22.004176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d5b35-5765-4981-8842-27e8f225643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:22.004843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5b35-5765-4981-8842-27e8f225643f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:22.005125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5b35-5765-4981-8842-27e8f225643f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:22.005404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d5b35-5765-4981-8842-27e8f225643f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:22.006237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d5b35-5765-4981-8842-27e8f225643f None admin] RBAC: Adding query filter params (group.id=de0abe9219324d18831cd1fa62d42082, role.id=1067c35f1111496c983a6a7dec2a5ad9, scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:22.006551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d5b35-5765-4981-8842-27e8f225643f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:22.008059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d5b35-5765-4981-8842-27e8f225643f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:22.014170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 226/445] 10.222.0.42 () {56 vars in 1376 bytes} [Fri May 27 13:39:21 2022] GET /identity/v3/role_assignments?group.id=de0abe9219324d18831cd1fa62d42082&scope.project.id=c8cb39fe7bad426e9aac2872667c1a1c&role.id=1067c35f1111496c983a6a7dec2a5ad9 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:22.014952 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d5b35-5765-4981-8842-27e8f225643f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:22.035683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f106d9e-a272-453e-b036-df5ec899bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:22.036425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f106d9e-a272-453e-b036-df5ec899bc93 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:22.036686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f106d9e-a272-453e-b036-df5ec899bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:22.036982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f106d9e-a272-453e-b036-df5ec899bc93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:22.055269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:22.140281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d5b35-5765-4981-8842-27e8f225643f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:22.148763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f106d9e-a272-453e-b036-df5ec899bc93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:22.150273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f106d9e-a272-453e-b036-df5ec899bc93 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:22.188637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b89c9-45ad-483c-a275-fd1c2b58cf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:22.189436 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b89c9-45ad-483c-a275-fd1c2b58cf88 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:22.189733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b89c9-45ad-483c-a275-fd1c2b58cf88 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:22.190011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b89c9-45ad-483c-a275-fd1c2b58cf88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:22.205839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b89c9-45ad-483c-a275-fd1c2b58cf88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-895b89c9-45ad-483c-a275-fd1c2b58cf88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:22.211545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:22.212429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:22.213693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 227/446] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:39:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:22.214860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:22.218931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b89c9-45ad-483c-a275-fd1c2b58cf88 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:22.268910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 220/447] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:22.274479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f106d9e-a272-453e-b036-df5ec899bc93 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:22.319358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:22.326066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b89c9-45ad-483c-a275-fd1c2b58cf88 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:22.359411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd58c3-77bc-4bd9-9df5-fbb441d83064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:22.360069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd58c3-77bc-4bd9-9df5-fbb441d83064 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:22.360350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd58c3-77bc-4bd9-9df5-fbb441d83064 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:22.360626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd58c3-77bc-4bd9-9df5-fbb441d83064 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:22.361362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd58c3-77bc-4bd9-9df5-fbb441d83064 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:22.361665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd58c3-77bc-4bd9-9df5-fbb441d83064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:22.363113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd58c3-77bc-4bd9-9df5-fbb441d83064 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:22.371084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 228/448] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:22.373112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f106d9e-a272-453e-b036-df5ec899bc93 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:22.377019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd58c3-77bc-4bd9-9df5-fbb441d83064 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:22.407708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb588c-3a92-4414-90e9-e0969e0d7b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:22.408572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb588c-3a92-4414-90e9-e0969e0d7b9c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:22.408849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb588c-3a92-4414-90e9-e0969e0d7b9c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:22.409137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb588c-3a92-4414-90e9-e0969e0d7b9c None admin] PATH_INFO: `/v3/projects/b3755fb9019c4a62a3376df0865a1020` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:22.410330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb588c-3a92-4414-90e9-e0969e0d7b9c None admin] RBAC: Authorizing `identity:get_project(project_id=b3755fb9019c4a62a3376df0865a1020)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:22.411819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb588c-3a92-4414-90e9-e0969e0d7b9c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:22.413505 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 221/449] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:22 2022] GET /identity/v3/projects/b3755fb9019c4a62a3376df0865a1020 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:22.419735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb588c-3a92-4414-90e9-e0969e0d7b9c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:22.445600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:22.478265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd58c3-77bc-4bd9-9df5-fbb441d83064 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:22.511160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcfdd1-0ecb-4c1e-b639-32df4338599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:22.511838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcfdd1-0ecb-4c1e-b639-32df4338599b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:22.512123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcfdd1-0ecb-4c1e-b639-32df4338599b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:22.512907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcfdd1-0ecb-4c1e-b639-32df4338599b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:22.522256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb588c-3a92-4414-90e9-e0969e0d7b9c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:22.538186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:22.556337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc5fe6-64f0-49ef-9c59-96300e8082ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:22.557190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5fe6-64f0-49ef-9c59-96300e8082ac None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:22.557649 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5fe6-64f0-49ef-9c59-96300e8082ac None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:22.557858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc5fe6-64f0-49ef-9c59-96300e8082ac None admin] PATH_INFO: `/v3/groups/de0abe9219324d18831cd1fa62d42082` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:22.559071 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc5fe6-64f0-49ef-9c59-96300e8082ac None admin] RBAC: Authorizing `identity:get_group(group_id=de0abe9219324d18831cd1fa62d42082)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:22.561067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc5fe6-64f0-49ef-9c59-96300e8082ac None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:22.562699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 222/450] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:22 2022] GET /identity/v3/groups/de0abe9219324d18831cd1fa62d42082 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:22.568371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc5fe6-64f0-49ef-9c59-96300e8082ac None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:22.582208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcfdd1-0ecb-4c1e-b639-32df4338599b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:22.583680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcfdd1-0ecb-4c1e-b639-32df4338599b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:22.662014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:22.672091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc5fe6-64f0-49ef-9c59-96300e8082ac None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:22.686519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 229/451] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 13:39:22.692106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcfdd1-0ecb-4c1e-b639-32df4338599b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:22.708423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebda0a4-286f-426c-946c-49e63426df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:22.709081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebda0a4-286f-426c-946c-49e63426df9a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:22.709365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebda0a4-286f-426c-946c-49e63426df9a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:22.709637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebda0a4-286f-426c-946c-49e63426df9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:22.710489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebda0a4-286f-426c-946c-49e63426df9a None admin] RBAC: Adding query filter params (group.id=de0abe9219324d18831cd1fa62d42082, role.id=a97f5aba7e1b4044b2c749cba5d5708f, scope.project.id=b3755fb9019c4a62a3376df0865a1020) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:22.710799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebda0a4-286f-426c-946c-49e63426df9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:22.712271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebda0a4-286f-426c-946c-49e63426df9a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:22.718457 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 223/452] 10.222.0.42 () {56 vars in 1376 bytes} [Fri May 27 13:39:22 2022] GET /identity/v3/role_assignments?group.id=de0abe9219324d18831cd1fa62d42082&scope.project.id=b3755fb9019c4a62a3376df0865a1020&role.id=a97f5aba7e1b4044b2c749cba5d5708f => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:22.752965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:22.799296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcfdd1-0ecb-4c1e-b639-32df4338599b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:22.833434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b26e5-729e-43fc-a8ef-dff678a1ceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:22.834302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b26e5-729e-43fc-a8ef-dff678a1ceb5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:22.834579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b26e5-729e-43fc-a8ef-dff678a1ceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:22.834851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b26e5-729e-43fc-a8ef-dff678a1ceb5 None admin] PATH_INFO: `/v3/projects/a72e15fb71aa4010bb48da49b133708a` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:22.836083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b26e5-729e-43fc-a8ef-dff678a1ceb5 None admin] RBAC: Authorizing `identity:get_project(project_id=a72e15fb71aa4010bb48da49b133708a)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:22.837545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b26e5-729e-43fc-a8ef-dff678a1ceb5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:22.839294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 230/453] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:39:22 2022] GET /identity/v3/projects/a72e15fb71aa4010bb48da49b133708a => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:22.845668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebda0a4-286f-426c-946c-49e63426df9a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:22.952188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebda0a4-286f-426c-946c-49e63426df9a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:22.988104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b160bf7-567c-465d-b18c-5b3f4331cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:22.988966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160bf7-567c-465d-b18c-5b3f4331cd76 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:22.989240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160bf7-567c-465d-b18c-5b3f4331cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:22.989516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b160bf7-567c-465d-b18c-5b3f4331cd76 None admin] PATH_INFO: `/v3/groups/8e2cb60b2f734bbc9be269e8f41f2a34` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:22.990691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160bf7-567c-465d-b18c-5b3f4331cd76 None admin] RBAC: Authorizing `identity:get_group(group_id=8e2cb60b2f734bbc9be269e8f41f2a34)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:22.992210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b160bf7-567c-465d-b18c-5b3f4331cd76 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:22.993830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 224/454] 10.222.0.42 () {56 vars in 1180 bytes} [Fri May 27 13:39:22 2022] GET /identity/v3/groups/8e2cb60b2f734bbc9be269e8f41f2a34 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:23.000166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b26e5-729e-43fc-a8ef-dff678a1ceb5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:23.103362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b26e5-729e-43fc-a8ef-dff678a1ceb5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:23.127867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:23.138094 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9033e2-95c1-40c6-a9b9-15f999892bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:23.138755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9033e2-95c1-40c6-a9b9-15f999892bf2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:23.139065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9033e2-95c1-40c6-a9b9-15f999892bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:23.139343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9033e2-95c1-40c6-a9b9-15f999892bf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:23.140187 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9033e2-95c1-40c6-a9b9-15f999892bf2 None admin] RBAC: Adding query filter params (group.id=8e2cb60b2f734bbc9be269e8f41f2a34, role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=a72e15fb71aa4010bb48da49b133708a) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:23.140477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9033e2-95c1-40c6-a9b9-15f999892bf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:23.141896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9033e2-95c1-40c6-a9b9-15f999892bf2 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:23.147825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 231/455] 10.222.0.42 () {56 vars in 1376 bytes} [Fri May 27 13:39:22 2022] GET /identity/v3/role_assignments?group.id=8e2cb60b2f734bbc9be269e8f41f2a34&scope.project.id=a72e15fb71aa4010bb48da49b133708a&role.id=3951cc86a51d416fafc5676d456e79ce => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:25.785816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e5b2b-2bfd-4d01-9f73-7045eaa89aa5 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:25.786368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e5b2b-2bfd-4d01-9f73-7045eaa89aa5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:25.786368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e5b2b-2bfd-4d01-9f73-7045eaa89aa5 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:25.788008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 225/456] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:25.793064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6710-b6cb-439c-80ef-4a65c034effe None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:25.793649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6710-b6cb-439c-80ef-4a65c034effe None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:25.793649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6710-b6cb-439c-80ef-4a65c034effe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:25.816384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-6ecc6710-b6cb-439c-80ef-4a65c034effe None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:25.817558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6ecc6710-b6cb-439c-80ef-4a65c034effe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:25.920793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 232/457] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:25.939518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e311dd-715a-425a-af19-ac3f85adae27 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:25.940090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e311dd-715a-425a-af19-ac3f85adae27 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:25.940582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e311dd-715a-425a-af19-ac3f85adae27 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:25.942364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 226/458] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:25.947946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d33b97-ea40-4770-a252-e4751f641fd0 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:25.948239 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d33b97-ea40-4770-a252-e4751f641fd0 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:25.948520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d33b97-ea40-4770-a252-e4751f641fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:25.958321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e311dd-715a-425a-af19-ac3f85adae27 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:25.971122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-08d33b97-ea40-4770-a252-e4751f641fd0 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:25.972310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-08d33b97-ea40-4770-a252-e4751f641fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:25.985133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:26.104873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 233/459] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:26.119738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e311dd-715a-425a-af19-ac3f85adae27 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:26.171795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6d90f-d57d-4dbb-b58e-01dae399679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:26.172610 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6d90f-d57d-4dbb-b58e-01dae399679c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:26.172892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6d90f-d57d-4dbb-b58e-01dae399679c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:26.173420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6d90f-d57d-4dbb-b58e-01dae399679c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:26.175747 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d33b97-ea40-4770-a252-e4751f641fd0 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:26.194894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6d90f-d57d-4dbb-b58e-01dae399679c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:26.196791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6d90f-d57d-4dbb-b58e-01dae399679c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-d7e6d90f-d57d-4dbb-b58e-01dae399679c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:26.224873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:26.225787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:26.226621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:26.226621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:26.226621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:26.226621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:26.228628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 227/460] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:26.234810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6d90f-d57d-4dbb-b58e-01dae399679c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:26.297691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:26.381765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:26.399543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d33b97-ea40-4770-a252-e4751f641fd0 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:26.429094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6d90f-d57d-4dbb-b58e-01dae399679c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:26.458002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c93c0-7e3f-4b20-bb55-20721aba1575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:26.458847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c93c0-7e3f-4b20-bb55-20721aba1575 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:26.459296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c93c0-7e3f-4b20-bb55-20721aba1575 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:26.459576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c93c0-7e3f-4b20-bb55-20721aba1575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:26.471893 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621a353-0f77-4793-af4e-28f16641b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:26.472831 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c93c0-7e3f-4b20-bb55-20721aba1575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:26.472942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a353-0f77-4793-af4e-28f16641b96a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:26.473410 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a353-0f77-4793-af4e-28f16641b96a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:26.473882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a353-0f77-4793-af4e-28f16641b96a None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:26.474275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c93c0-7e3f-4b20-bb55-20721aba1575 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:26.475153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621a353-0f77-4793-af4e-28f16641b96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:26.475684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621a353-0f77-4793-af4e-28f16641b96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:26.477395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621a353-0f77-4793-af4e-28f16641b96a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:26.490373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 228/461] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:26.491994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4098cc-a6fd-4ffa-b3ef-0c8706a43529 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:26.492481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4098cc-a6fd-4ffa-b3ef-0c8706a43529 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:26.492951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4098cc-a6fd-4ffa-b3ef-0c8706a43529 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-7a3c93c0-7e3f-4b20-bb55-20721aba1575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:26.494466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:26.495323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:26.496134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:26.496134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:26.496134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:26.496134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:26.496134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 234/462] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:26.497320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c93c0-7e3f-4b20-bb55-20721aba1575 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:26.497835 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 229/463] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:26.502448 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4098cc-a6fd-4ffa-b3ef-0c8706a43529 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:26.614535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:26.617455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c93c0-7e3f-4b20-bb55-20721aba1575 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:26.628814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4098cc-a6fd-4ffa-b3ef-0c8706a43529 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:26.656439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f12d1-3059-4c00-9687-8425a627ed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:26.657114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f12d1-3059-4c00-9687-8425a627ed85 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:26.657398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f12d1-3059-4c00-9687-8425a627ed85 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:26.657677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f12d1-3059-4c00-9687-8425a627ed85 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:26.658391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f12d1-3059-4c00-9687-8425a627ed85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:26.659854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f12d1-3059-4c00-9687-8425a627ed85 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:26.668397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f7218-8fbc-4b8d-a8e0-9037f06e0012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:26.669726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f7218-8fbc-4b8d-a8e0-9037f06e0012 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:26.670014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f7218-8fbc-4b8d-a8e0-9037f06e0012 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:26.670294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f7218-8fbc-4b8d-a8e0-9037f06e0012 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:26.671096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f7218-8fbc-4b8d-a8e0-9037f06e0012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:26.671444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f7218-8fbc-4b8d-a8e0-9037f06e0012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:26.672817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f7218-8fbc-4b8d-a8e0-9037f06e0012 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:26.675258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:26.686148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 230/464] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:26.688137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae57fdd-a7ff-4bc3-a641-0227d0dcd38c None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:26.688137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae57fdd-a7ff-4bc3-a641-0227d0dcd38c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:26.688137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae57fdd-a7ff-4bc3-a641-0227d0dcd38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:26.708108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-aae57fdd-a7ff-4bc3-a641-0227d0dcd38c None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:26.709216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-aae57fdd-a7ff-4bc3-a641-0227d0dcd38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:26.776491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 231/465] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:26.778642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737253b-4c34-4248-9b45-810b529f3da8 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:26.778871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737253b-4c34-4248-9b45-810b529f3da8 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:26.779231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737253b-4c34-4248-9b45-810b529f3da8 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:26.780760 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 232/466] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:26.781280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737253b-4c34-4248-9b45-810b529f3da8 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:26.805905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 235/467] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:39:26 2022] POST /identity/v3/users => generated 246 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:39:26.809482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4e974-0c07-4389-ae13-a18acebbd49e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:26.810410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4e974-0c07-4389-ae13-a18acebbd49e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:26.811535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4e974-0c07-4389-ae13-a18acebbd49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:26.837352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-6bd4e974-0c07-4389-ae13-a18acebbd49e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:26.839849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6bd4e974-0c07-4389-ae13-a18acebbd49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:26.900392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737253b-4c34-4248-9b45-810b529f3da8 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:26.941970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:26.957656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 236/468] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:26.964038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4e974-0c07-4389-ae13-a18acebbd49e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:26.964209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161985a-3fef-40d6-8049-de8937675aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:26.964209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161985a-3fef-40d6-8049-de8937675aaa None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:26.964421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161985a-3fef-40d6-8049-de8937675aaa None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:26.964746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161985a-3fef-40d6-8049-de8937675aaa None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:26.965493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161985a-3fef-40d6-8049-de8937675aaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:26.967157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161985a-3fef-40d6-8049-de8937675aaa None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:27.063143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 233/469] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:39:26 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:39:27.064395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:27.067056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161985a-3fef-40d6-8049-de8937675aaa None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:27.083143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4e974-0c07-4389-ae13-a18acebbd49e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:27.139375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fc37d-d5ef-4287-9a4a-023c77b44d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:27.140237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fc37d-d5ef-4287-9a4a-023c77b44d76 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:27.140513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fc37d-d5ef-4287-9a4a-023c77b44d76 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:27.140995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fc37d-d5ef-4287-9a4a-023c77b44d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:27.158870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fc37d-d5ef-4287-9a4a-023c77b44d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:27.161453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fc37d-d5ef-4287-9a4a-023c77b44d76 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-f37fc37d-d5ef-4287-9a4a-023c77b44d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:27.187315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:27.188214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:27.189055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:27.189055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:27.189055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:27.189055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:27.189055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 237/470] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:27.197067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fc37d-d5ef-4287-9a4a-023c77b44d76 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:27.262036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161985a-3fef-40d6-8049-de8937675aaa None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:27.321353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715f2c-f77f-468f-92c8-bff613bd5a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:27.322532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715f2c-f77f-468f-92c8-bff613bd5a50 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:27.323053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715f2c-f77f-468f-92c8-bff613bd5a50 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:27.323524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715f2c-f77f-468f-92c8-bff613bd5a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:27.329709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fc37d-d5ef-4287-9a4a-023c77b44d76 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:27.335737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715f2c-f77f-468f-92c8-bff613bd5a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:27.338300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715f2c-f77f-468f-92c8-bff613bd5a50 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-4c715f2c-f77f-468f-92c8-bff613bd5a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:27.360570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:27.361473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:27.362294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:27.362294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:27.362294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:27.362294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:27.362294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 234/471] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:27.366772 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fcec0-72a0-4166-917c-788d3c3c0393 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:27.367120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fcec0-72a0-4166-917c-788d3c3c0393 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:27.367399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fcec0-72a0-4166-917c-788d3c3c0393 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:27.368836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 235/472] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:27.369413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fcec0-72a0-4166-917c-788d3c3c0393 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:27.373236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0bb32-f570-4831-b9ee-f75a9657fdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:27.373907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0bb32-f570-4831-b9ee-f75a9657fdac None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:27.374185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0bb32-f570-4831-b9ee-f75a9657fdac None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:27.374455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0bb32-f570-4831-b9ee-f75a9657fdac None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:27.375213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0bb32-f570-4831-b9ee-f75a9657fdac None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:27.375519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0bb32-f570-4831-b9ee-f75a9657fdac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:27.376993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0bb32-f570-4831-b9ee-f75a9657fdac None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:27.385769 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:27.389615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 238/473] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:27.390881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d83e8-5990-4d08-9a43-077a0f83215e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:27.391186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d83e8-5990-4d08-9a43-077a0f83215e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:27.391537 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d83e8-5990-4d08-9a43-077a0f83215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:27.410365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-315d83e8-5990-4d08-9a43-077a0f83215e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:27.412026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:27.412146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-315d83e8-5990-4d08-9a43-077a0f83215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:27.494557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 239/474] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:27.496574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d83e8-5990-4d08-9a43-077a0f83215e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:27.514700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fcec0-72a0-4166-917c-788d3c3c0393 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:27.552848 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90434989-7a00-4bd9-b8c5-666a0b60d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:27.553615 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90434989-7a00-4bd9-b8c5-666a0b60d14f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:27.553969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90434989-7a00-4bd9-b8c5-666a0b60d14f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:27.554347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90434989-7a00-4bd9-b8c5-666a0b60d14f None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:27.555311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90434989-7a00-4bd9-b8c5-666a0b60d14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:27.555736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90434989-7a00-4bd9-b8c5-666a0b60d14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:27.557340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90434989-7a00-4bd9-b8c5-666a0b60d14f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:27.571622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 236/475] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:27.572659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90434989-7a00-4bd9-b8c5-666a0b60d14f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:27.612666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d83e8-5990-4d08-9a43-077a0f83215e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:27.655642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:27.667098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b8da0-43e6-4186-b92c-9b2e1b562b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:27.672421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b8da0-43e6-4186-b92c-9b2e1b562b45 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:27.672929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b8da0-43e6-4186-b92c-9b2e1b562b45 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:27.673718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b8da0-43e6-4186-b92c-9b2e1b562b45 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:27.675546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b8da0-43e6-4186-b92c-9b2e1b562b45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:27.679354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b8da0-43e6-4186-b92c-9b2e1b562b45 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:27.705519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:27.714408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90434989-7a00-4bd9-b8c5-666a0b60d14f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:27.749534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cbd69-53df-408d-a82e-5f37c0d6c2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:27.750301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cbd69-53df-408d-a82e-5f37c0d6c2e8 None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:27.750583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cbd69-53df-408d-a82e-5f37c0d6c2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:27.750855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cbd69-53df-408d-a82e-5f37c0d6c2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:27.751634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cbd69-53df-408d-a82e-5f37c0d6c2e8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:27.752998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cbd69-53df-408d-a82e-5f37c0d6c2e8 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:27.794026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.sql.core [None req-bc2cbd69-53df-408d-a82e-5f37c0d6c2e8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 13:39:27.794026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 13:39:27.794026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [parameters: {'id': '69b406949e914b10b59b88bf56d0df22', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 13:39:27.794026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92065) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 13:39:27.807126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 240/476] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:39:27 2022] POST /identity/v3/users => generated 248 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:39:27.808080 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b8da0-43e6-4186-b92c-9b2e1b562b45 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-bc2cbd69-53df-408d-a82e-5f37c0d6c2e8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application result = self._query(query) May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application conn.query(q) May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application result.read() May 27 13:39:27.815248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return ref.to_dict() May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 13:39:27.816216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application next(self.gen) May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application yield resource May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application next(self.gen) May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self.session.rollback() May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self.force_reraise() May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise self.value May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application session.commit() May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 13:39:27.817087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._prepare_impl() May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self.session.flush() May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._flush(objects) May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application compat.raise_( May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application flush_context.execute() May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rec.execute(self) May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 13:39:27.817979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 13:39:27.818845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application result = self._query(query) May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application conn.query(q) May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application result.read() May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 13:39:27.822504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [parameters: {'id': '69b406949e914b10b59b88bf56d0df22', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:27.824475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 13:39:27.826901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:27.832114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 237/477] 10.222.0.42 () {60 vars in 1131 bytes} [Fri May 27 13:39:27 2022] POST /identity/v3/roles => generated 144 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:27.841123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cbd69-53df-408d-a82e-5f37c0d6c2e8 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:27.986838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b8da0-43e6-4186-b92c-9b2e1b562b45 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:28.027716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1db319-4e31-45cd-b0b3-355db3fd018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:28.029228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1db319-4e31-45cd-b0b3-355db3fd018a None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:28.029700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1db319-4e31-45cd-b0b3-355db3fd018a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:28.030076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1db319-4e31-45cd-b0b3-355db3fd018a None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:28.030883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1db319-4e31-45cd-b0b3-355db3fd018a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:28.032673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1db319-4e31-45cd-b0b3-355db3fd018a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:28.076878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cbd69-53df-408d-a82e-5f37c0d6c2e8 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:28.119392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 241/478] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:39:27 2022] POST /identity/v3/users => generated 249 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:39:28.120410 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7b804-2551-45d3-8101-07eb210d334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:28.121318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b804-2551-45d3-8101-07eb210d334e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:28.121515 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b804-2551-45d3-8101-07eb210d334e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:28.122292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7b804-2551-45d3-8101-07eb210d334e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:28.136417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7b804-2551-45d3-8101-07eb210d334e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-b8c7b804-2551-45d3-8101-07eb210d334e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:28.145518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:28.146484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:28.147783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 238/479] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:39:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:28.153342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1db319-4e31-45cd-b0b3-355db3fd018a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:28.204460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:28.278308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1db319-4e31-45cd-b0b3-355db3fd018a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:28.317444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f16a8-f0ac-4afd-8adb-0e2ba2ba6b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:28.318116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f16a8-f0ac-4afd-8adb-0e2ba2ba6b99 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:28.318404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f16a8-f0ac-4afd-8adb-0e2ba2ba6b99 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:28.318672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f16a8-f0ac-4afd-8adb-0e2ba2ba6b99 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:28.319451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f16a8-f0ac-4afd-8adb-0e2ba2ba6b99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:28.319755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f16a8-f0ac-4afd-8adb-0e2ba2ba6b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:28.321126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f16a8-f0ac-4afd-8adb-0e2ba2ba6b99 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:28.331100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 242/480] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:29.526231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc439b0-c956-4403-95f1-6c12255bb22b None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:29.526863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc439b0-c956-4403-95f1-6c12255bb22b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:29.526863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc439b0-c956-4403-95f1-6c12255bb22b None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:29.529172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 239/481] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:29.536528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de559c19-299c-4cee-a029-dbb57171d78e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:29.536528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de559c19-299c-4cee-a029-dbb57171d78e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:29.536528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de559c19-299c-4cee-a029-dbb57171d78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:29.557638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-de559c19-299c-4cee-a029-dbb57171d78e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:29.559979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-de559c19-299c-4cee-a029-dbb57171d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:29.636760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 243/482] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:29.676659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc439b0-c956-4403-95f1-6c12255bb22b None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:29.709918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:29.826903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc439b0-c956-4403-95f1-6c12255bb22b None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:29.861588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e40ea0-5621-4c17-a217-952fa0c6310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:29.862386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40ea0-5621-4c17-a217-952fa0c6310b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:29.862667 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40ea0-5621-4c17-a217-952fa0c6310b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:29.862937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e40ea0-5621-4c17-a217-952fa0c6310b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:29.874290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e40ea0-5621-4c17-a217-952fa0c6310b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-b6e40ea0-5621-4c17-a217-952fa0c6310b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:29.882078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:29.883050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:29.884151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 240/483] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:29.891212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de559c19-299c-4cee-a029-dbb57171d78e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:29.900970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037fb2d-b196-43b7-98a9-e4ca54518424 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:29.900970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037fb2d-b196-43b7-98a9-e4ca54518424 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:29.900970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037fb2d-b196-43b7-98a9-e4ca54518424 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:29.900970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 241/484] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:29.906401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e1a06-d79f-4648-9763-2f55033526c3 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:29.906665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e1a06-d79f-4648-9763-2f55033526c3 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:29.906927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e1a06-d79f-4648-9763-2f55033526c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:29.939787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-aa4e1a06-d79f-4648-9763-2f55033526c3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:29.940992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-aa4e1a06-d79f-4648-9763-2f55033526c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:29.969479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:30.025044 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de559c19-299c-4cee-a029-dbb57171d78e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:30.065518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dd3cd-f18e-4d97-88da-8d702ac42ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:30.066332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd3cd-f18e-4d97-88da-8d702ac42ff5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:30.066753 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd3cd-f18e-4d97-88da-8d702ac42ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:30.067063 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd3cd-f18e-4d97-88da-8d702ac42ff5 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:30.067823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dd3cd-f18e-4d97-88da-8d702ac42ff5 None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:30.068134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dd3cd-f18e-4d97-88da-8d702ac42ff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:30.069509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dd3cd-f18e-4d97-88da-8d702ac42ff5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:30.079287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 244/485] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:30.084389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dd3cd-f18e-4d97-88da-8d702ac42ff5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:30.099021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 242/486] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:30.132293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e1a06-d79f-4648-9763-2f55033526c3 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:30.143327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:30.273794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:30.283906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dd3cd-f18e-4d97-88da-8d702ac42ff5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:30.331081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e1a06-d79f-4648-9763-2f55033526c3 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:30.374035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88300-f3e7-4b30-97e6-7530cf8062b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:30.374845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88300-f3e7-4b30-97e6-7530cf8062b7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:30.375154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88300-f3e7-4b30-97e6-7530cf8062b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:30.375428 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88300-f3e7-4b30-97e6-7530cf8062b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:30.383691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611b3b4-516c-4828-9725-7b07ab398183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:30.384613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611b3b4-516c-4828-9725-7b07ab398183 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:30.384894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611b3b4-516c-4828-9725-7b07ab398183 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:30.385165 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611b3b4-516c-4828-9725-7b07ab398183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:30.386781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88300-f3e7-4b30-97e6-7530cf8062b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-4ad88300-f3e7-4b30-97e6-7530cf8062b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:30.395460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:30.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:30.397688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 243/487] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:30.402383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88300-f3e7-4b30-97e6-7530cf8062b7 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:30.412841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611b3b4-516c-4828-9725-7b07ab398183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:30.414515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611b3b4-516c-4828-9725-7b07ab398183 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-a611b3b4-516c-4828-9725-7b07ab398183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:30.466096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:30.468632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:30.470703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:30.470703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:30.470703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:30.470703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:30.475536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 245/488] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:30.479995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611b3b4-516c-4828-9725-7b07ab398183 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:30.480226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:30.523957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88300-f3e7-4b30-97e6-7530cf8062b7 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:30.592644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0aea4-367b-42ed-83ba-95221c609e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:30.593411 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0aea4-367b-42ed-83ba-95221c609e46 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:30.593575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0aea4-367b-42ed-83ba-95221c609e46 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:30.599017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0aea4-367b-42ed-83ba-95221c609e46 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:30.599017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0aea4-367b-42ed-83ba-95221c609e46 None admin] RBAC: Adding query filter params (name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:30.599017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0aea4-367b-42ed-83ba-95221c609e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:30.599017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0aea4-367b-42ed-83ba-95221c609e46 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:30.606305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 244/489] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:30.613235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0aea4-367b-42ed-83ba-95221c609e46 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:30.620294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611b3b4-516c-4828-9725-7b07ab398183 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:30.695871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3559353-650e-40ee-964a-4adc6860a095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:30.696542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3559353-650e-40ee-964a-4adc6860a095 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:30.696824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3559353-650e-40ee-964a-4adc6860a095 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:30.697106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3559353-650e-40ee-964a-4adc6860a095 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:30.697911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3559353-650e-40ee-964a-4adc6860a095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:30.698222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3559353-650e-40ee-964a-4adc6860a095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:30.700205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3559353-650e-40ee-964a-4adc6860a095 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:30.714416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 246/490] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:30.720879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3559353-650e-40ee-964a-4adc6860a095 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:30.735664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:30.835592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0aea4-367b-42ed-83ba-95221c609e46 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:30.859121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3559353-650e-40ee-964a-4adc6860a095 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:30.886266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:30.896043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f934d-3f1d-4f35-97e5-b026a2bbca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:30.896969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f934d-3f1d-4f35-97e5-b026a2bbca59 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:30.897355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f934d-3f1d-4f35-97e5-b026a2bbca59 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:30.897711 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f934d-3f1d-4f35-97e5-b026a2bbca59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:30.911109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f934d-3f1d-4f35-97e5-b026a2bbca59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:30.912749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f934d-3f1d-4f35-97e5-b026a2bbca59 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:30.917371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3848e6-d6f7-49fd-bd23-665dc12a31f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:30.918198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3848e6-d6f7-49fd-bd23-665dc12a31f2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:30.918546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3848e6-d6f7-49fd-bd23-665dc12a31f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:30.918805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3848e6-d6f7-49fd-bd23-665dc12a31f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:30.929821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3848e6-d6f7-49fd-bd23-665dc12a31f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:30.931361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3848e6-d6f7-49fd-bd23-665dc12a31f2 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-939f934d-3f1d-4f35-97e5-b026a2bbca59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:30.932655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:30.933484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:30.934878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:30.934878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:30.934878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:30.934878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:30.939463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 245/491] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:30.940989 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b8cdd-c62b-4aeb-8de8-c0b738c079e3 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:30.941283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b8cdd-c62b-4aeb-8de8-c0b738c079e3 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:30.941569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b8cdd-c62b-4aeb-8de8-c0b738c079e3 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:30.943249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 246/492] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:30.943972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b8cdd-c62b-4aeb-8de8-c0b738c079e3 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-1b3848e6-d6f7-49fd-bd23-665dc12a31f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:30.953295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:30.955583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 247/493] 10.222.0.42 () {56 vars in 1093 bytes} [Fri May 27 13:39:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf8107-ce3a-4342-a854-3c25e4e98f90 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:30.957797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf8107-ce3a-4342-a854-3c25e4e98f90 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:30.959543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf8107-ce3a-4342-a854-3c25e4e98f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:30.978764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-1caf8107-ce3a-4342-a854-3c25e4e98f90 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:30.980446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1caf8107-ce3a-4342-a854-3c25e4e98f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:31.048001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:31.063088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 248/494] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:31.069089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf8107-ce3a-4342-a854-3c25e4e98f90 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:31.085024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b8cdd-c62b-4aeb-8de8-c0b738c079e3 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:31.122934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e40f2-879f-4f61-a3ef-cf2e8a9574f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:31.123657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e40f2-879f-4f61-a3ef-cf2e8a9574f1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.123941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e40f2-879f-4f61-a3ef-cf2e8a9574f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.124421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e40f2-879f-4f61-a3ef-cf2e8a9574f1 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.125151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e40f2-879f-4f61-a3ef-cf2e8a9574f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:31.125458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e40f2-879f-4f61-a3ef-cf2e8a9574f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:31.126885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e40f2-879f-4f61-a3ef-cf2e8a9574f1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:31.139879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 247/495] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:31.141408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365440-5779-4e9d-8f35-d9824c4cc6c3 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.141796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365440-5779-4e9d-8f35-d9824c4cc6c3 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.141972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365440-5779-4e9d-8f35-d9824c4cc6c3 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.143567 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 248/496] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:31.144279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365440-5779-4e9d-8f35-d9824c4cc6c3 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:31.184832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf8107-ce3a-4342-a854-3c25e4e98f90 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:31.188174 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:31.218567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c92420-1b2a-4fa1-ba30-c22ba1adc3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:31.219273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c92420-1b2a-4fa1-ba30-c22ba1adc3e0 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.219554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c92420-1b2a-4fa1-ba30-c22ba1adc3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.219830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c92420-1b2a-4fa1-ba30-c22ba1adc3e0 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.220696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c92420-1b2a-4fa1-ba30-c22ba1adc3e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:31.221001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c92420-1b2a-4fa1-ba30-c22ba1adc3e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:31.222433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c92420-1b2a-4fa1-ba30-c22ba1adc3e0 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:31.245842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365440-5779-4e9d-8f35-d9824c4cc6c3 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:31.258409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 249/497] 10.222.0.42 () {56 vars in 1133 bytes} [Fri May 27 13:39:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:31.259729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3732df-1e87-447c-bec4-efe215a17b75 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.260018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3732df-1e87-447c-bec4-efe215a17b75 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.260294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3732df-1e87-447c-bec4-efe215a17b75 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.261514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 250/498] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:31.262724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3732df-1e87-447c-bec4-efe215a17b75 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:31.287936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700f99-990e-4b9e-9c75-a728f82dfa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:31.288733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700f99-990e-4b9e-9c75-a728f82dfa42 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.289019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700f99-990e-4b9e-9c75-a728f82dfa42 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.289296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700f99-990e-4b9e-9c75-a728f82dfa42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.299965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700f99-990e-4b9e-9c75-a728f82dfa42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-b6700f99-990e-4b9e-9c75-a728f82dfa42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:31.307687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:31.308624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:31.309621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 249/499] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:31.310553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd221c4-6a35-443f-87e3-63c5bb33140c None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.310719 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd221c4-6a35-443f-87e3-63c5bb33140c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.311010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd221c4-6a35-443f-87e3-63c5bb33140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.325965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:31.327733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-dfd221c4-6a35-443f-87e3-63c5bb33140c None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:31.328926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-dfd221c4-6a35-443f-87e3-63c5bb33140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:31.370438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3732df-1e87-447c-bec4-efe215a17b75 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:31.395894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 250/500] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:31.396780 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd221c4-6a35-443f-87e3-63c5bb33140c None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:31.404601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02963596-ba78-4582-8b1d-ae1971fbf4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:31.405384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02963596-ba78-4582-8b1d-ae1971fbf4e9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.405666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02963596-ba78-4582-8b1d-ae1971fbf4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.405957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02963596-ba78-4582-8b1d-ae1971fbf4e9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.413011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02963596-ba78-4582-8b1d-ae1971fbf4e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:31.414361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02963596-ba78-4582-8b1d-ae1971fbf4e9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-02963596-ba78-4582-8b1d-ae1971fbf4e9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:31.429612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:31.430518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:31.431425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 251/501] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:31.432175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e92e4-fb88-4ec5-8a2e-61f4da1d7565 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.432512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e92e4-fb88-4ec5-8a2e-61f4da1d7565 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.432673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e92e4-fb88-4ec5-8a2e-61f4da1d7565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.444475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:31.449093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-247e92e4-fb88-4ec5-8a2e-61f4da1d7565 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:31.450301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-247e92e4-fb88-4ec5-8a2e-61f4da1d7565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:31.514871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd221c4-6a35-443f-87e3-63c5bb33140c None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:31.516124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 252/502] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:31.516957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e92e4-fb88-4ec5-8a2e-61f4da1d7565 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:31.564015 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c7a2-3a23-4e35-bfcc-3e76d7592910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:31.564668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c7a2-3a23-4e35-bfcc-3e76d7592910 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.564949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c7a2-3a23-4e35-bfcc-3e76d7592910 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.565222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22c7a2-3a23-4e35-bfcc-3e76d7592910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.566150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:31.619705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e92e4-fb88-4ec5-8a2e-61f4da1d7565 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:31.632584 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22c7a2-3a23-4e35-bfcc-3e76d7592910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:31.634048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22c7a2-3a23-4e35-bfcc-3e76d7592910 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:31.654591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b90b78-567a-4f55-bac3-e200bd8c9360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:31.655213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b90b78-567a-4f55-bac3-e200bd8c9360 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.655495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b90b78-567a-4f55-bac3-e200bd8c9360 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.655770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b90b78-567a-4f55-bac3-e200bd8c9360 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.656514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b90b78-567a-4f55-bac3-e200bd8c9360 None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:31.656818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b90b78-567a-4f55-bac3-e200bd8c9360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:31.658187 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b90b78-567a-4f55-bac3-e200bd8c9360 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:31.664076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:31.666549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 253/503] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:31.667367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b90b78-567a-4f55-bac3-e200bd8c9360 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:31.735302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 251/504] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:31.736154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c7a2-3a23-4e35-bfcc-3e76d7592910 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:31.768261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b90b78-567a-4f55-bac3-e200bd8c9360 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:31.775194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:31.803147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd88e4a-142a-4e93-9f09-002d6b11b0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:31.804304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88e4a-142a-4e93-9f09-002d6b11b0be None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.804587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88e4a-142a-4e93-9f09-002d6b11b0be None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.804869 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd88e4a-142a-4e93-9f09-002d6b11b0be None admin] PATH_INFO: `/v3/roles/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.814961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd88e4a-142a-4e93-9f09-002d6b11b0be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-edd88e4a-142a-4e93-9f09-002d6b11b0be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:31.822828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:31.823891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 254/505] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:31.824875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd88e4a-142a-4e93-9f09-002d6b11b0be None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:31.836730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22c7a2-3a23-4e35-bfcc-3e76d7592910 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:31.866104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:31.871973 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b2071-2bb2-46f8-a452-e053aa49c870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:31.872664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b2071-2bb2-46f8-a452-e053aa49c870 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.872948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b2071-2bb2-46f8-a452-e053aa49c870 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.873227 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b2071-2bb2-46f8-a452-e053aa49c870 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.874074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b2071-2bb2-46f8-a452-e053aa49c870 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:31.874383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b2071-2bb2-46f8-a452-e053aa49c870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:31.875876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b2071-2bb2-46f8-a452-e053aa49c870 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:31.913099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 252/506] 10.222.0.42 () {56 vars in 1137 bytes} [Fri May 27 13:39:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:31.913861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b2071-2bb2-46f8-a452-e053aa49c870 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:31.924199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd88e4a-142a-4e93-9f09-002d6b11b0be None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:31.957239 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad429e00-8cfe-42d3-b64f-079ef20886a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:31.958025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad429e00-8cfe-42d3-b64f-079ef20886a3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:31.958305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad429e00-8cfe-42d3-b64f-079ef20886a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:31.958585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad429e00-8cfe-42d3-b64f-079ef20886a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:31.970416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad429e00-8cfe-42d3-b64f-079ef20886a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:31.971902 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad429e00-8cfe-42d3-b64f-079ef20886a3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ad429e00-8cfe-42d3-b64f-079ef20886a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:31.988636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:31.989485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:31.990310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:31.990310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:31.990310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:31.990310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:31.990310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 255/507] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:31.991500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad429e00-8cfe-42d3-b64f-079ef20886a3 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:32.010003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:32.015453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b2071-2bb2-46f8-a452-e053aa49c870 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:32.049460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184e044-01f1-43d9-85d8-698725d27771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:32.050239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184e044-01f1-43d9-85d8-698725d27771 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:32.050519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184e044-01f1-43d9-85d8-698725d27771 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:32.050788 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184e044-01f1-43d9-85d8-698725d27771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:32.061377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184e044-01f1-43d9-85d8-698725d27771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:32.062850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184e044-01f1-43d9-85d8-698725d27771 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-9184e044-01f1-43d9-85d8-698725d27771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:32.081062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:32.081890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:32.082740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:32.082740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:32.082740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:32.082740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:32.082740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 253/508] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:32.083135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184e044-01f1-43d9-85d8-698725d27771 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:32.093809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad429e00-8cfe-42d3-b64f-079ef20886a3 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:32.125739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:32.127907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251490f-a3be-484a-aa72-1cebe87030e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:32.128685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251490f-a3be-484a-aa72-1cebe87030e4 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:32.128964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251490f-a3be-484a-aa72-1cebe87030e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:32.129236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251490f-a3be-484a-aa72-1cebe87030e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:32.140000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251490f-a3be-484a-aa72-1cebe87030e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:32.141482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251490f-a3be-484a-aa72-1cebe87030e4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-4251490f-a3be-484a-aa72-1cebe87030e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:32.159433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:32.160279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:32.161150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:32.161150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:32.161150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:32.161150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:32.161150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 256/509] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:32.161455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251490f-a3be-484a-aa72-1cebe87030e4 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:32.187825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184e044-01f1-43d9-85d8-698725d27771 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:32.222620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a0002-dc04-442d-9f08-8c29c725b959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:32.223317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a0002-dc04-442d-9f08-8c29c725b959 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:32.223607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a0002-dc04-442d-9f08-8c29c725b959 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:32.223882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a0002-dc04-442d-9f08-8c29c725b959 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:32.224634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a0002-dc04-442d-9f08-8c29c725b959 None admin] RBAC: Adding query filter params (name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:32.224940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a0002-dc04-442d-9f08-8c29c725b959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:32.226329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5a0002-dc04-442d-9f08-8c29c725b959 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:32.230586 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:32.234305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 254/510] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:32.235127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a0002-dc04-442d-9f08-8c29c725b959 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:32.314138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251490f-a3be-484a-aa72-1cebe87030e4 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:32.346996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b2828-1193-422d-a081-41fc497ba2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:32.347640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b2828-1193-422d-a081-41fc497ba2ec None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:32.347916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b2828-1193-422d-a081-41fc497ba2ec None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:32.348188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b2828-1193-422d-a081-41fc497ba2ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:32.380087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a0002-dc04-442d-9f08-8c29c725b959 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:32.381606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:32.414067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7966a-9dff-4773-9376-f6a474b9e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:32.414730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7966a-9dff-4773-9376-f6a474b9e8af None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:32.415033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7966a-9dff-4773-9376-f6a474b9e8af None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:32.415312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7966a-9dff-4773-9376-f6a474b9e8af None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:32.416037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7966a-9dff-4773-9376-f6a474b9e8af None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:32.416295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b2828-1193-422d-a081-41fc497ba2ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:32.416402 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7966a-9dff-4773-9376-f6a474b9e8af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:32.417704 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7966a-9dff-4773-9376-f6a474b9e8af None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:32.417806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b2828-1193-422d-a081-41fc497ba2ec None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:32.429570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 255/511] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:32.430361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7966a-9dff-4773-9376-f6a474b9e8af None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:32.484710 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:32.514940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 257/512] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:32.515794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b2828-1193-422d-a081-41fc497ba2ec None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:32.529192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7966a-9dff-4773-9376-f6a474b9e8af None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:32.564744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf891f0-0408-4f8e-86a3-4af4b41a918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:32.565262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf891f0-0408-4f8e-86a3-4af4b41a918e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:32.565612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf891f0-0408-4f8e-86a3-4af4b41a918e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:32.565958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf891f0-0408-4f8e-86a3-4af4b41a918e None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:32.566755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf891f0-0408-4f8e-86a3-4af4b41a918e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:32.567106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf891f0-0408-4f8e-86a3-4af4b41a918e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:32.568498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf891f0-0408-4f8e-86a3-4af4b41a918e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:32.581134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 256/513] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:32.581932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf891f0-0408-4f8e-86a3-4af4b41a918e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:32.605553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:32.615453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b2828-1193-422d-a081-41fc497ba2ec None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:32.652553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29499ac2-9db3-4993-b7ee-928deda27836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:32.653225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29499ac2-9db3-4993-b7ee-928deda27836 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:32.653503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29499ac2-9db3-4993-b7ee-928deda27836 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:32.653775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29499ac2-9db3-4993-b7ee-928deda27836 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:32.654486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29499ac2-9db3-4993-b7ee-928deda27836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:32.654790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29499ac2-9db3-4993-b7ee-928deda27836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:32.656317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29499ac2-9db3-4993-b7ee-928deda27836 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:32.669304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 258/514] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:32.670731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29499ac2-9db3-4993-b7ee-928deda27836 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:32.683811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf891f0-0408-4f8e-86a3-4af4b41a918e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:32.703730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:32.718508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcaaea-d9f8-4364-9758-15fcab5cc96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:32.719332 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcaaea-d9f8-4364-9758-15fcab5cc96b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:32.719611 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcaaea-d9f8-4364-9758-15fcab5cc96b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:32.719887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcaaea-d9f8-4364-9758-15fcab5cc96b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:32.729739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcaaea-d9f8-4364-9758-15fcab5cc96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:32.731758 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcaaea-d9f8-4364-9758-15fcab5cc96b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-00fcaaea-d9f8-4364-9758-15fcab5cc96b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:32.749353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:32.750380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:32.751422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:32.751422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:32.751422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:32.751422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:32.751422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 257/515] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:32.751422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcaaea-d9f8-4364-9758-15fcab5cc96b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:32.774580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29499ac2-9db3-4993-b7ee-928deda27836 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:32.808776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d2c8b-d392-4904-b577-579b574bf9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:32.809517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d2c8b-d392-4904-b577-579b574bf9d6 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:32.809799 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d2c8b-d392-4904-b577-579b574bf9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:32.810072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d2c8b-d392-4904-b577-579b574bf9d6 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:32.810778 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d2c8b-d392-4904-b577-579b574bf9d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:32.812238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d2c8b-d392-4904-b577-579b574bf9d6 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:32.826581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:32.850712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcaaea-d9f8-4364-9758-15fcab5cc96b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:32.884247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26d3eb-6335-4aa6-9c6b-dead28b37903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:32.885065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26d3eb-6335-4aa6-9c6b-dead28b37903 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:32.885346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26d3eb-6335-4aa6-9c6b-dead28b37903 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:32.885621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26d3eb-6335-4aa6-9c6b-dead28b37903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:32.895433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 259/516] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:39:32 2022] POST /identity/v3/users => generated 247 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:39:32.895565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26d3eb-6335-4aa6-9c6b-dead28b37903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:32.896253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d2c8b-d392-4904-b577-579b574bf9d6 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:32.897174 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26d3eb-6335-4aa6-9c6b-dead28b37903 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-6c26d3eb-6335-4aa6-9c6b-dead28b37903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:32.925832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:32.926793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:32.927999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:32.927999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:32.927999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:32.927999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:32.928548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 258/517] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:32.929649 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26d3eb-6335-4aa6-9c6b-dead28b37903 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:33.009809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:33.026610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d2c8b-d392-4904-b577-579b574bf9d6 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.043360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26d3eb-6335-4aa6-9c6b-dead28b37903 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.066318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4fc34-b8a6-469a-90fa-594ffd4e6afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:33.067160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4fc34-b8a6-469a-90fa-594ffd4e6afc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:33.067447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4fc34-b8a6-469a-90fa-594ffd4e6afc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:33.067718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4fc34-b8a6-469a-90fa-594ffd4e6afc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:33.075762 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4fc34-b8a6-469a-90fa-594ffd4e6afc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:33.076716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:33.077367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4fc34-b8a6-469a-90fa-594ffd4e6afc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:33.086839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916ba73-33ce-4554-a466-bedf23cc346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:33.088187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916ba73-33ce-4554-a466-bedf23cc346e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:33.088187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916ba73-33ce-4554-a466-bedf23cc346e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:33.088187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916ba73-33ce-4554-a466-bedf23cc346e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-b4f4fc34-b8a6-469a-90fa-594ffd4e6afc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:33.094932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:33.095963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 260/518] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:33.096990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4fc34-b8a6-469a-90fa-594ffd4e6afc None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:33.101826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916ba73-33ce-4554-a466-bedf23cc346e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:33.103532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916ba73-33ce-4554-a466-bedf23cc346e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-0916ba73-33ce-4554-a466-bedf23cc346e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:33.120491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:33.121533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:33.122730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:33.122730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:33.122730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:33.122730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:33.122730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:33.122730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:33.122730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:33.122730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:33.122730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 259/519] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:33.123915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916ba73-33ce-4554-a466-bedf23cc346e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:33.210461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4fc34-b8a6-469a-90fa-594ffd4e6afc None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.239925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916ba73-33ce-4554-a466-bedf23cc346e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.244890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32e147-a7fb-4ebd-95fa-817e99367ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:33.245555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32e147-a7fb-4ebd-95fa-817e99367ebe None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:33.245843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32e147-a7fb-4ebd-95fa-817e99367ebe None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:33.246121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32e147-a7fb-4ebd-95fa-817e99367ebe None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:33.247397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32e147-a7fb-4ebd-95fa-817e99367ebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:33.247708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32e147-a7fb-4ebd-95fa-817e99367ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:33.249072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32e147-a7fb-4ebd-95fa-817e99367ebe None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:33.260693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 261/520] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:33.265614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32e147-a7fb-4ebd-95fa-817e99367ebe None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:33.274302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:33.277697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebd398-7650-45e4-a0d8-aed7aee7909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:33.279002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebd398-7650-45e4-a0d8-aed7aee7909d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:33.279434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebd398-7650-45e4-a0d8-aed7aee7909d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:33.279799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebd398-7650-45e4-a0d8-aed7aee7909d None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:33.280812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebd398-7650-45e4-a0d8-aed7aee7909d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:33.285752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebd398-7650-45e4-a0d8-aed7aee7909d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:33.285752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebd398-7650-45e4-a0d8-aed7aee7909d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:33.295066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 260/521] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:33.295903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebd398-7650-45e4-a0d8-aed7aee7909d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:33.350421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:33.380461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32e147-a7fb-4ebd-95fa-817e99367ebe None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.408078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebd398-7650-45e4-a0d8-aed7aee7909d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.416618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb519df-0759-476a-a354-59d7318e3670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:33.417431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb519df-0759-476a-a354-59d7318e3670 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:33.417814 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb519df-0759-476a-a354-59d7318e3670 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:33.418201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb519df-0759-476a-a354-59d7318e3670 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:33.419788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb519df-0759-476a-a354-59d7318e3670 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:33.420095 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb519df-0759-476a-a354-59d7318e3670 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:33.421523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb519df-0759-476a-a354-59d7318e3670 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:33.439577 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 262/522] 10.222.0.42 () {56 vars in 1137 bytes} [Fri May 27 13:39:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:33.440392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb519df-0759-476a-a354-59d7318e3670 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:33.451921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccb3ee-6594-433e-9683-1f0d54647f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:33.453019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb3ee-6594-433e-9683-1f0d54647f65 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:33.453462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb3ee-6594-433e-9683-1f0d54647f65 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:33.453886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccb3ee-6594-433e-9683-1f0d54647f65 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:33.454953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccb3ee-6594-433e-9683-1f0d54647f65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:33.455296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccb3ee-6594-433e-9683-1f0d54647f65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:33.456861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccb3ee-6594-433e-9683-1f0d54647f65 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:33.477499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 261/523] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:33.478418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccb3ee-6594-433e-9683-1f0d54647f65 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:33.509193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:33.550048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb519df-0759-476a-a354-59d7318e3670 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.587820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaf143-98e9-4f2c-8a0b-91fe115222cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:33.588463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccb3ee-6594-433e-9683-1f0d54647f65 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.588856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaf143-98e9-4f2c-8a0b-91fe115222cf None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:33.589242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaf143-98e9-4f2c-8a0b-91fe115222cf None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:33.589616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaf143-98e9-4f2c-8a0b-91fe115222cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:33.597122 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:33.599410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaf143-98e9-4f2c-8a0b-91fe115222cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:33.600838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdaf143-98e9-4f2c-8a0b-91fe115222cf None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-efdaf143-98e9-4f2c-8a0b-91fe115222cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:33.618480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:33.619493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:33.620400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 263/524] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:33.621027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaf143-98e9-4f2c-8a0b-91fe115222cf None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:33.627889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917b5d-9f29-4993-8f46-4b36bf4d3b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:33.628689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917b5d-9f29-4993-8f46-4b36bf4d3b27 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:33.628973 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917b5d-9f29-4993-8f46-4b36bf4d3b27 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:33.629248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917b5d-9f29-4993-8f46-4b36bf4d3b27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:33.637126 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82917b5d-9f29-4993-8f46-4b36bf4d3b27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:33.639274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82917b5d-9f29-4993-8f46-4b36bf4d3b27 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-82917b5d-9f29-4993-8f46-4b36bf4d3b27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:33.654032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:33.655150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:33.656083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:33.656083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:33.656083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:33.656083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:33.656083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:33.656083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:33.656083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:33.656083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:33.656083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 262/525] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:33.657031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917b5d-9f29-4993-8f46-4b36bf4d3b27 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:33.738670 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaf143-98e9-4f2c-8a0b-91fe115222cf None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.764645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:33.772884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917b5d-9f29-4993-8f46-4b36bf4d3b27 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.786481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52323b-220a-4f86-b11d-23416450a2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:33.786481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52323b-220a-4f86-b11d-23416450a2c9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:33.786481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52323b-220a-4f86-b11d-23416450a2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:33.786481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52323b-220a-4f86-b11d-23416450a2c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:33.813587 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bc965-963f-41f9-8ae9-3f15c1d2b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:33.814181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bc965-963f-41f9-8ae9-3f15c1d2b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:33.814469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bc965-963f-41f9-8ae9-3f15c1d2b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:33.814750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bc965-963f-41f9-8ae9-3f15c1d2b9f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:33.815621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bc965-963f-41f9-8ae9-3f15c1d2b9f4 None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=9a1644fa5cd3499d9d6ad057067255e9) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:33.815942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bc965-963f-41f9-8ae9-3f15c1d2b9f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:33.817373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bc965-963f-41f9-8ae9-3f15c1d2b9f4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:33.831008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 263/526] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:33 2022] GET /identity/v3/role_assignments?user.id=9a1644fa5cd3499d9d6ad057067255e9&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:33.831008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bc965-963f-41f9-8ae9-3f15c1d2b9f4 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:33.862584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52323b-220a-4f86-b11d-23416450a2c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:33.864226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52323b-220a-4f86-b11d-23416450a2c9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:33.873634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:33.979629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bc965-963f-41f9-8ae9-3f15c1d2b9f4 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:33.988815 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 264/527] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:33.989915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52323b-220a-4f86-b11d-23416450a2c9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:34.021303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:34.030672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c460ca2-78da-4d89-95ab-d7cb29a7167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:34.032382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c460ca2-78da-4d89-95ab-d7cb29a7167e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:34.032382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c460ca2-78da-4d89-95ab-d7cb29a7167e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:34.032382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c460ca2-78da-4d89-95ab-d7cb29a7167e None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:34.033748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c460ca2-78da-4d89-95ab-d7cb29a7167e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:34.033748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c460ca2-78da-4d89-95ab-d7cb29a7167e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:34.034503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c460ca2-78da-4d89-95ab-d7cb29a7167e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:34.055377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 264/528] 10.222.0.42 () {56 vars in 1139 bytes} [Fri May 27 13:39:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:34.056274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c460ca2-78da-4d89-95ab-d7cb29a7167e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:34.127753 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52323b-220a-4f86-b11d-23416450a2c9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:34.158599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:34.164499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febc3f1-f06b-445d-8f0c-67de6f8f38ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:34.165172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febc3f1-f06b-445d-8f0c-67de6f8f38ac None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:34.165458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febc3f1-f06b-445d-8f0c-67de6f8f38ac None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:34.165788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febc3f1-f06b-445d-8f0c-67de6f8f38ac None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:34.166581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febc3f1-f06b-445d-8f0c-67de6f8f38ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:34.166893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febc3f1-f06b-445d-8f0c-67de6f8f38ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:34.168433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febc3f1-f06b-445d-8f0c-67de6f8f38ac None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:34.174845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c460ca2-78da-4d89-95ab-d7cb29a7167e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:34.191928 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 265/529] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:34.192872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febc3f1-f06b-445d-8f0c-67de6f8f38ac None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:34.217651 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846945-5d93-427d-a4cc-28775bc9eb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:34.218931 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846945-5d93-427d-a4cc-28775bc9eb1e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:34.226801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846945-5d93-427d-a4cc-28775bc9eb1e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:34.226801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78846945-5d93-427d-a4cc-28775bc9eb1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:34.236215 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78846945-5d93-427d-a4cc-28775bc9eb1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:34.238328 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78846945-5d93-427d-a4cc-28775bc9eb1e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-78846945-5d93-427d-a4cc-28775bc9eb1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:34.265996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:34.267144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:34.268102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:34.268102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:34.268102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:34.268102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:34.268102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 265/530] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:34.268436 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846945-5d93-427d-a4cc-28775bc9eb1e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:34.287969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:34.305627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febc3f1-f06b-445d-8f0c-67de6f8f38ac None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:34.343579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed94fc-4ac8-4a6f-9e6a-56329cbd87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:34.345141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed94fc-4ac8-4a6f-9e6a-56329cbd87a6 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:34.345581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed94fc-4ac8-4a6f-9e6a-56329cbd87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:34.346003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed94fc-4ac8-4a6f-9e6a-56329cbd87a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:34.385257 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78846945-5d93-427d-a4cc-28775bc9eb1e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:34.422520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb896f9d-c399-4d20-b757-f07c89a838f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:34.423319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb896f9d-c399-4d20-b757-f07c89a838f9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:34.423935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb896f9d-c399-4d20-b757-f07c89a838f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:34.424305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb896f9d-c399-4d20-b757-f07c89a838f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:34.425201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb896f9d-c399-4d20-b757-f07c89a838f9 None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=bbb36541c7ba418a843e5ecbb1f1e337) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:34.425590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb896f9d-c399-4d20-b757-f07c89a838f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:34.427164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb896f9d-c399-4d20-b757-f07c89a838f9 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:34.432258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed94fc-4ac8-4a6f-9e6a-56329cbd87a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:34.433088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 266/531] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:34 2022] GET /identity/v3/role_assignments?user.id=bbb36541c7ba418a843e5ecbb1f1e337&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:34.433941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb896f9d-c399-4d20-b757-f07c89a838f9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:34.434387 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed94fc-4ac8-4a6f-9e6a-56329cbd87a6 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:34.438363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:34.535287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:34.549096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb896f9d-c399-4d20-b757-f07c89a838f9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:34.555955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 266/532] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:34.565369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed94fc-4ac8-4a6f-9e6a-56329cbd87a6 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:34.589049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f6e95-7b37-408e-a8bb-2454d8f48e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:34.589928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f6e95-7b37-408e-a8bb-2454d8f48e34 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:34.590316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f6e95-7b37-408e-a8bb-2454d8f48e34 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:34.591291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f6e95-7b37-408e-a8bb-2454d8f48e34 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:34.592494 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f6e95-7b37-408e-a8bb-2454d8f48e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:34.592894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f6e95-7b37-408e-a8bb-2454d8f48e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:34.603006 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f6e95-7b37-408e-a8bb-2454d8f48e34 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:34.609626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 267/533] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:34.620194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f6e95-7b37-408e-a8bb-2454d8f48e34 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:34.703034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed94fc-4ac8-4a6f-9e6a-56329cbd87a6 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:34.741859 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c992fc4-32cf-48a2-aa91-4ad9fdb555a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:34.743424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c992fc4-32cf-48a2-aa91-4ad9fdb555a8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:34.743887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c992fc4-32cf-48a2-aa91-4ad9fdb555a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:34.744332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c992fc4-32cf-48a2-aa91-4ad9fdb555a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:34.755731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c992fc4-32cf-48a2-aa91-4ad9fdb555a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:34.757415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c992fc4-32cf-48a2-aa91-4ad9fdb555a8 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:34.776282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-4c992fc4-32cf-48a2-aa91-4ad9fdb555a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:34.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:34.781140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:34.782181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:34.782181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:34.782181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:34.782181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:34.784355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 267/534] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:34.794269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c992fc4-32cf-48a2-aa91-4ad9fdb555a8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:34.844377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:34.896897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f6e95-7b37-408e-a8bb-2454d8f48e34 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:34.917950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c992fc4-32cf-48a2-aa91-4ad9fdb555a8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:34.955467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31eb97-24c6-469b-818e-09366db7f193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:34.956053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31eb97-24c6-469b-818e-09366db7f193 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:34.956337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31eb97-24c6-469b-818e-09366db7f193 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:34.956614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31eb97-24c6-469b-818e-09366db7f193 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:34.957341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31eb97-24c6-469b-818e-09366db7f193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:34.957649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31eb97-24c6-469b-818e-09366db7f193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:34.959048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31eb97-24c6-469b-818e-09366db7f193 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:34.971519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 268/535] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:34.978032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31eb97-24c6-469b-818e-09366db7f193 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:34.996580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac42764-53d8-41c9-8442-b1d15bf5aa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:34.997468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42764-53d8-41c9-8442-b1d15bf5aa5a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:34.997749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42764-53d8-41c9-8442-b1d15bf5aa5a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:34.998023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac42764-53d8-41c9-8442-b1d15bf5aa5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:35.005349 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac42764-53d8-41c9-8442-b1d15bf5aa5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:35.007168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac42764-53d8-41c9-8442-b1d15bf5aa5a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-fac42764-53d8-41c9-8442-b1d15bf5aa5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:35.021829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:35.022683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:35.023556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:35.023556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:35.023556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:35.023556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:35.023556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:35.023556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:35.023556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:35.023556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:35.027874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 268/536] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:35.029717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac42764-53d8-41c9-8442-b1d15bf5aa5a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:35.116843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:35.126504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31eb97-24c6-469b-818e-09366db7f193 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:35.184591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334510a-aa2c-42b2-8f4a-31e67e16e578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:35.185414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334510a-aa2c-42b2-8f4a-31e67e16e578 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:35.185703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334510a-aa2c-42b2-8f4a-31e67e16e578 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:35.185981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334510a-aa2c-42b2-8f4a-31e67e16e578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:35.197242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac42764-53d8-41c9-8442-b1d15bf5aa5a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:35.198236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334510a-aa2c-42b2-8f4a-31e67e16e578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:35.208052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334510a-aa2c-42b2-8f4a-31e67e16e578 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:35.226829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-2334510a-aa2c-42b2-8f4a-31e67e16e578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:35.229837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:35.230666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:35.232767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:35.232767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:35.232767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:35.232767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:35.232767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:35.232767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:35.232767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:35.232767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:35.234674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 269/537] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:35.238944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334510a-aa2c-42b2-8f4a-31e67e16e578 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:35.246430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b645a4f-d4be-455b-947c-8ef006e2bb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:35.248786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b645a4f-d4be-455b-947c-8ef006e2bb76 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:35.248786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b645a4f-d4be-455b-947c-8ef006e2bb76 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:35.248786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b645a4f-d4be-455b-947c-8ef006e2bb76 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:35.249547 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b645a4f-d4be-455b-947c-8ef006e2bb76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:35.249871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b645a4f-d4be-455b-947c-8ef006e2bb76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:35.251368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b645a4f-d4be-455b-947c-8ef006e2bb76 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:35.282842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 269/538] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:35.290340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b645a4f-d4be-455b-947c-8ef006e2bb76 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:35.431705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334510a-aa2c-42b2-8f4a-31e67e16e578 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:35.459528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b645a4f-d4be-455b-947c-8ef006e2bb76 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:35.471416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90f3c5-d2ae-4c3f-8459-2cef2e16e667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:35.472167 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90f3c5-d2ae-4c3f-8459-2cef2e16e667 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:35.472523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90f3c5-d2ae-4c3f-8459-2cef2e16e667 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:35.472871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90f3c5-d2ae-4c3f-8459-2cef2e16e667 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:35.473663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90f3c5-d2ae-4c3f-8459-2cef2e16e667 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:35.473971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90f3c5-d2ae-4c3f-8459-2cef2e16e667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:35.475453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90f3c5-d2ae-4c3f-8459-2cef2e16e667 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:35.493057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 270/539] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:35.494775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef59b-8d06-4b9b-a9bd-b9ce8ed43509 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:35.495089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef59b-8d06-4b9b-a9bd-b9ce8ed43509 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:35.495370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ef59b-8d06-4b9b-a9bd-b9ce8ed43509 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:35.496914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 271/540] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:35.499055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef59b-8d06-4b9b-a9bd-b9ce8ed43509 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:35.510516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73d77-62ed-4094-bbd7-4107ae05c4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:35.511230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73d77-62ed-4094-bbd7-4107ae05c4d5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:35.511516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73d77-62ed-4094-bbd7-4107ae05c4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:35.511794 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73d77-62ed-4094-bbd7-4107ae05c4d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:35.513103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73d77-62ed-4094-bbd7-4107ae05c4d5 None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=8e3e451167fc4984be9726430f436e40) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:35.513422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73d77-62ed-4094-bbd7-4107ae05c4d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:35.515331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73d77-62ed-4094-bbd7-4107ae05c4d5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:35.521719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:35.527113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 270/541] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:35 2022] GET /identity/v3/role_assignments?user.id=8e3e451167fc4984be9726430f436e40&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:35.528555 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a454-b847-4391-b8b4-687a09fb4fdb None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:35.529087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a454-b847-4391-b8b4-687a09fb4fdb None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:35.529554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a454-b847-4391-b8b4-687a09fb4fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:35.551457 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3fb4a454-b847-4391-b8b4-687a09fb4fdb None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:35.552948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3fb4a454-b847-4391-b8b4-687a09fb4fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:35.626377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:35.647579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 271/542] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:35.695441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ef59b-8d06-4b9b-a9bd-b9ce8ed43509 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:35.699482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4a454-b847-4391-b8b4-687a09fb4fdb None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:35.784460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb376a-0606-4889-8074-ede087811f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:35.785146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb376a-0606-4889-8074-ede087811f51 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:35.786676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb376a-0606-4889-8074-ede087811f51 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:35.786954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb376a-0606-4889-8074-ede087811f51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:35.787816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb376a-0606-4889-8074-ede087811f51 None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=7afc19dc502f425faf693eb963fe63d4) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:35.788123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb376a-0606-4889-8074-ede087811f51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:35.789542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb376a-0606-4889-8074-ede087811f51 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:35.796328 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 272/543] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:35 2022] GET /identity/v3/role_assignments?user.id=7afc19dc502f425faf693eb963fe63d4&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:35.844936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4a454-b847-4391-b8b4-687a09fb4fdb None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:35.890137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b9cf-4060-4d94-9932-81f6e6337eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:35.891372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b9cf-4060-4d94-9932-81f6e6337eb9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:35.891868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b9cf-4060-4d94-9932-81f6e6337eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:35.892367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326b9cf-4060-4d94-9932-81f6e6337eb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:35.905682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326b9cf-4060-4d94-9932-81f6e6337eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-9326b9cf-4060-4d94-9932-81f6e6337eb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:35.914125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:35.915036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:35.915837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:35.923392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 272/544] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:35.926165 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb376a-0606-4889-8074-ede087811f51 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:36.018664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:36.044082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb376a-0606-4889-8074-ede087811f51 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:36.081706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe2f74-2257-45af-a40b-963c847a3a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:36.082388 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe2f74-2257-45af-a40b-963c847a3a79 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:36.082674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe2f74-2257-45af-a40b-963c847a3a79 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:36.083036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe2f74-2257-45af-a40b-963c847a3a79 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:36.083822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe2f74-2257-45af-a40b-963c847a3a79 None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:36.084175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe2f74-2257-45af-a40b-963c847a3a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:36.085552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe2f74-2257-45af-a40b-963c847a3a79 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:36.095275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 273/545] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:36.100814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b9cf-4060-4d94-9932-81f6e6337eb9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:36.145784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:36.211668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326b9cf-4060-4d94-9932-81f6e6337eb9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:36.241851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69127-6ba0-44d4-a959-6b0ba506e35a None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:36.242154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69127-6ba0-44d4-a959-6b0ba506e35a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:36.242477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69127-6ba0-44d4-a959-6b0ba506e35a None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:36.244513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 274/546] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:36.253542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c114d0-f868-4004-b430-e2dc08d96dc9 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:36.254093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c114d0-f868-4004-b430-e2dc08d96dc9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:36.254581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c114d0-f868-4004-b430-e2dc08d96dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:36.267684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac872f93-a3c4-42bf-8a11-68c73d824eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:36.268825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac872f93-a3c4-42bf-8a11-68c73d824eff None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:36.269335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac872f93-a3c4-42bf-8a11-68c73d824eff None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:36.269808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac872f93-a3c4-42bf-8a11-68c73d824eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:36.284346 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-37c114d0-f868-4004-b430-e2dc08d96dc9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:36.287815 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-37c114d0-f868-4004-b430-e2dc08d96dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:36.291856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac872f93-a3c4-42bf-8a11-68c73d824eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:36.293685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac872f93-a3c4-42bf-8a11-68c73d824eff None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-ac872f93-a3c4-42bf-8a11-68c73d824eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:36.321468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:36.322323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:36.323724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:36.323724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:36.323724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:36.323724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:36.334158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 273/547] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:36.339541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac872f93-a3c4-42bf-8a11-68c73d824eff None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:36.436731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 275/548] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:36.462944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:36.475141 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac872f93-a3c4-42bf-8a11-68c73d824eff None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:36.500229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c114d0-f868-4004-b430-e2dc08d96dc9 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:36.511302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d69f9a-ba67-44a3-ad14-efdcc85941a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:36.512659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d69f9a-ba67-44a3-ad14-efdcc85941a1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:36.513254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d69f9a-ba67-44a3-ad14-efdcc85941a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:36.513645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d69f9a-ba67-44a3-ad14-efdcc85941a1 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:36.514573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d69f9a-ba67-44a3-ad14-efdcc85941a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:36.515107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d69f9a-ba67-44a3-ad14-efdcc85941a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:36.516589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d69f9a-ba67-44a3-ad14-efdcc85941a1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:36.529600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 274/549] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:36.534846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d69f9a-ba67-44a3-ad14-efdcc85941a1 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:36.649501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d69f9a-ba67-44a3-ad14-efdcc85941a1 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:36.680322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:36.688655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a49e83-3e74-481f-b41b-002466e65059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:36.693991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a49e83-3e74-481f-b41b-002466e65059 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:36.693991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a49e83-3e74-481f-b41b-002466e65059 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:36.693991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a49e83-3e74-481f-b41b-002466e65059 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:36.698882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a49e83-3e74-481f-b41b-002466e65059 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:36.701115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a49e83-3e74-481f-b41b-002466e65059 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-e7a49e83-3e74-481f-b41b-002466e65059 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:36.722923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:36.724125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:36.725345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:36.725345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:36.725345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:36.725345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:36.725345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:36.725345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:36.725345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:36.725345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:36.725345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 13:39:36.725345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:36.728086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 275/550] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:39:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:36.734994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a49e83-3e74-481f-b41b-002466e65059 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:36.770169 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:36.770368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c114d0-f868-4004-b430-e2dc08d96dc9 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:36.839732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ebc9-4d8b-41a6-85ed-8dc5a6bd9ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:36.841357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ebc9-4d8b-41a6-85ed-8dc5a6bd9ed9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:36.841623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ebc9-4d8b-41a6-85ed-8dc5a6bd9ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:36.841903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149ebc9-4d8b-41a6-85ed-8dc5a6bd9ed9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:36.867015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149ebc9-4d8b-41a6-85ed-8dc5a6bd9ed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-e149ebc9-4d8b-41a6-85ed-8dc5a6bd9ed9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:36.872755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:36.873649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:36.874463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:36.875127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a49e83-3e74-481f-b41b-002466e65059 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:36.875532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 276/551] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:36.883913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ebc9-4d8b-41a6-85ed-8dc5a6bd9ed9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:36.941699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7e5f9-ba20-47a9-91e1-f59f4206a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:36.942440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7e5f9-ba20-47a9-91e1-f59f4206a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:36.942822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7e5f9-ba20-47a9-91e1-f59f4206a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:36.943194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7e5f9-ba20-47a9-91e1-f59f4206a2d6 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:36.944123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7e5f9-ba20-47a9-91e1-f59f4206a2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:36.944511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7e5f9-ba20-47a9-91e1-f59f4206a2d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:36.946130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7e5f9-ba20-47a9-91e1-f59f4206a2d6 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:36.967281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 276/552] 10.222.0.42 () {56 vars in 1135 bytes} [Fri May 27 13:39:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:36.973848 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7e5f9-ba20-47a9-91e1-f59f4206a2d6 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:37.063817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149ebc9-4d8b-41a6-85ed-8dc5a6bd9ed9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:37.092571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:37.099333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:37.104616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ae853-1d1e-49f3-9366-c753c691821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:37.105627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ae853-1d1e-49f3-9366-c753c691821d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:37.106639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ae853-1d1e-49f3-9366-c753c691821d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:37.107384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ae853-1d1e-49f3-9366-c753c691821d None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:37.108316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ae853-1d1e-49f3-9366-c753c691821d None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:37.108790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ae853-1d1e-49f3-9366-c753c691821d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:37.110350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ae853-1d1e-49f3-9366-c753c691821d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:37.119424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 277/553] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:37.128003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ae853-1d1e-49f3-9366-c753c691821d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:37.157572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7e5f9-ba20-47a9-91e1-f59f4206a2d6 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:37.221192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeabb7e-01a0-4537-8678-4d4cfd3d6c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:37.222328 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeabb7e-01a0-4537-8678-4d4cfd3d6c9b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:37.222757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeabb7e-01a0-4537-8678-4d4cfd3d6c9b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:37.223595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeabb7e-01a0-4537-8678-4d4cfd3d6c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:37.281493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ae853-1d1e-49f3-9366-c753c691821d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:37.319813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeabb7e-01a0-4537-8678-4d4cfd3d6c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:37.321531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeabb7e-01a0-4537-8678-4d4cfd3d6c9b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:37.327147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fb1e4-f2fe-4fa1-8856-47e5709814e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:37.328287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fb1e4-f2fe-4fa1-8856-47e5709814e5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:37.328787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fb1e4-f2fe-4fa1-8856-47e5709814e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:37.329199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fb1e4-f2fe-4fa1-8856-47e5709814e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:37.340274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fb1e4-f2fe-4fa1-8856-47e5709814e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:37.342142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fb1e4-f2fe-4fa1-8856-47e5709814e5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-d31fb1e4-f2fe-4fa1-8856-47e5709814e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:37.360476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:37.361466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:37.362348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:37.362348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:37.362348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:37.362348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:37.364602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 278/554] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:37.366133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268610b-c89c-4c84-871d-d2283c8f58ff None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:37.366622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268610b-c89c-4c84-871d-d2283c8f58ff None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:37.367097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268610b-c89c-4c84-871d-d2283c8f58ff None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:37.368876 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 279/555] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:37.369797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268610b-c89c-4c84-871d-d2283c8f58ff None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:37.399743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:37.420555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:37.438898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 277/556] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:37.440470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f8958-bc9e-4b54-800e-7d767aff3bf7 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:37.440937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f8958-bc9e-4b54-800e-7d767aff3bf7 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:37.441396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f8958-bc9e-4b54-800e-7d767aff3bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:37.460185 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fa1f8958-bc9e-4b54-800e-7d767aff3bf7 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:37.461657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fa1f8958-bc9e-4b54-800e-7d767aff3bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:37.476872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268610b-c89c-4c84-871d-d2283c8f58ff None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:37.512733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676d094-f7c0-4c79-b21e-29332b2f3fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:37.513529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676d094-f7c0-4c79-b21e-29332b2f3fc0 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:37.513775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676d094-f7c0-4c79-b21e-29332b2f3fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:37.514106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676d094-f7c0-4c79-b21e-29332b2f3fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:37.514913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676d094-f7c0-4c79-b21e-29332b2f3fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:37.515463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676d094-f7c0-4c79-b21e-29332b2f3fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:37.517188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3676d094-f7c0-4c79-b21e-29332b2f3fc0 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:37.529688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 280/557] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:37.530839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676d094-f7c0-4c79-b21e-29332b2f3fc0 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:37.547113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 278/558] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:37.548783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f8958-bc9e-4b54-800e-7d767aff3bf7 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:37.656726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676d094-f7c0-4c79-b21e-29332b2f3fc0 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:37.670637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:37.673145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:37.680138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f8958-bc9e-4b54-800e-7d767aff3bf7 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:37.716000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42769061-472b-451b-ac2e-8d8a618f8a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:37.716665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebef64b-ed73-4b13-9d4c-f43e753cf1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:37.717472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebef64b-ed73-4b13-9d4c-f43e753cf1f7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:37.717757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebef64b-ed73-4b13-9d4c-f43e753cf1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:37.718035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebef64b-ed73-4b13-9d4c-f43e753cf1f7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:37.718805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42769061-472b-451b-ac2e-8d8a618f8a4e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:37.719416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42769061-472b-451b-ac2e-8d8a618f8a4e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:37.719884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42769061-472b-451b-ac2e-8d8a618f8a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:37.726418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebef64b-ed73-4b13-9d4c-f43e753cf1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:37.728092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebef64b-ed73-4b13-9d4c-f43e753cf1f7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:37.737052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42769061-472b-451b-ac2e-8d8a618f8a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:37.739329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42769061-472b-451b-ac2e-8d8a618f8a4e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-5ebef64b-ed73-4b13-9d4c-f43e753cf1f7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:37.745726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:37.746697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:37.748337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 279/559] 10.222.0.42 () {56 vars in 1093 bytes} [Fri May 27 13:39:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:37.748916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebef64b-ed73-4b13-9d4c-f43e753cf1f7 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-42769061-472b-451b-ac2e-8d8a618f8a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:37.768076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:37.769093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:37.769986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:37.769986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:37.769986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:37.769986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:37.772377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 281/560] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:37.773556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42769061-472b-451b-ac2e-8d8a618f8a4e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:37.864237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebef64b-ed73-4b13-9d4c-f43e753cf1f7 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:37.901806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859986b-3e03-436b-ba64-786778891502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:37.903274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859986b-3e03-436b-ba64-786778891502 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:37.903893 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859986b-3e03-436b-ba64-786778891502 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:37.904280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859986b-3e03-436b-ba64-786778891502 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:37.913164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42769061-472b-451b-ac2e-8d8a618f8a4e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:37.917375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859986b-3e03-436b-ba64-786778891502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-3859986b-3e03-436b-ba64-786778891502 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:37.926008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:37.927134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:37.928153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:37.930302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 280/561] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:37.931433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859986b-3e03-436b-ba64-786778891502 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:37.956554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:37.972662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef6f0d-a469-41f9-a6d8-c6ce49a7a069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:37.973569 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6f0d-a469-41f9-a6d8-c6ce49a7a069 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:37.974156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6f0d-a469-41f9-a6d8-c6ce49a7a069 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:37.974576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef6f0d-a469-41f9-a6d8-c6ce49a7a069 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:37.976409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef6f0d-a469-41f9-a6d8-c6ce49a7a069 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:37.976987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef6f0d-a469-41f9-a6d8-c6ce49a7a069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:37.978622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef6f0d-a469-41f9-a6d8-c6ce49a7a069 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:38.002377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 282/562] 10.222.0.42 () {56 vars in 1133 bytes} [Fri May 27 13:39:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:38.003463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef6f0d-a469-41f9-a6d8-c6ce49a7a069 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:38.022374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:38.080350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859986b-3e03-436b-ba64-786778891502 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.117181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957dbc1-9421-46eb-97eb-62f80129c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:38.118009 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957dbc1-9421-46eb-97eb-62f80129c1aa None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.118418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957dbc1-9421-46eb-97eb-62f80129c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.118851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f957dbc1-9421-46eb-97eb-62f80129c1aa None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.119636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957dbc1-9421-46eb-97eb-62f80129c1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:38.120048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957dbc1-9421-46eb-97eb-62f80129c1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:38.122211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f957dbc1-9421-46eb-97eb-62f80129c1aa None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:38.126059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef6f0d-a469-41f9-a6d8-c6ce49a7a069 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.135906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 281/563] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:38.137435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957dbc1-9421-46eb-97eb-62f80129c1aa None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:38.172305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055081a-63ba-44cb-ab84-0f31732e402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:38.173135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055081a-63ba-44cb-ab84-0f31732e402a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.173836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055081a-63ba-44cb-ab84-0f31732e402a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.174300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055081a-63ba-44cb-ab84-0f31732e402a None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.180365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055081a-63ba-44cb-ab84-0f31732e402a None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:38.180365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055081a-63ba-44cb-ab84-0f31732e402a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:38.180365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0055081a-63ba-44cb-ab84-0f31732e402a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:38.190997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 283/564] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:38.190997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055081a-63ba-44cb-ab84-0f31732e402a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:38.241986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:38.266807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f957dbc1-9421-46eb-97eb-62f80129c1aa None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.294830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:38.304481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3b4f5-0563-4a84-a0a2-aa57c52b183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:38.305268 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3b4f5-0563-4a84-a0a2-aa57c52b183a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.305549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3b4f5-0563-4a84-a0a2-aa57c52b183a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.305819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3b4f5-0563-4a84-a0a2-aa57c52b183a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.316514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055081a-63ba-44cb-ab84-0f31732e402a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.317488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3b4f5-0563-4a84-a0a2-aa57c52b183a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:38.318942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3b4f5-0563-4a84-a0a2-aa57c52b183a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-35b3b4f5-0563-4a84-a0a2-aa57c52b183a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:38.337490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:38.338432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:38.339369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:38.339369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:38.339369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:38.339369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:38.339369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 282/565] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:38.339649 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3b4f5-0563-4a84-a0a2-aa57c52b183a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:38.358427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437e369-6f7b-479a-b337-073bc04261b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:38.359361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437e369-6f7b-479a-b337-073bc04261b5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.359644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437e369-6f7b-479a-b337-073bc04261b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.359918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437e369-6f7b-479a-b337-073bc04261b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.367042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437e369-6f7b-479a-b337-073bc04261b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:38.368487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437e369-6f7b-479a-b337-073bc04261b5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-a437e369-6f7b-479a-b337-073bc04261b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:38.383407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:38.384323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:38.385192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:38.385192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:38.385192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:38.385192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:38.385192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:38.385192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:38.385192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:38.385192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:38.389423 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 284/566] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:38.390807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d33c0a-d625-417a-a34a-f01fdd5ef654 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.391396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d33c0a-d625-417a-a34a-f01fdd5ef654 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.391396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d33c0a-d625-417a-a34a-f01fdd5ef654 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.395038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 285/567] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:38.395038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d33c0a-d625-417a-a34a-f01fdd5ef654 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:38.451674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3b4f5-0563-4a84-a0a2-aa57c52b183a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.483495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:38.489208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c260b01-701a-489a-8bcb-fcfdf25aa604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:38.489994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260b01-701a-489a-8bcb-fcfdf25aa604 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.490325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260b01-701a-489a-8bcb-fcfdf25aa604 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.490601 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260b01-701a-489a-8bcb-fcfdf25aa604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.499654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d33c0a-d625-417a-a34a-f01fdd5ef654 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.501290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c260b01-701a-489a-8bcb-fcfdf25aa604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:38.502823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c260b01-701a-489a-8bcb-fcfdf25aa604 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-6c260b01-701a-489a-8bcb-fcfdf25aa604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:38.520605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:38.521569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:38.522446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:38.522446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:38.522446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:38.522446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:38.522446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 283/568] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:38.522752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c260b01-701a-489a-8bcb-fcfdf25aa604 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:38.538300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a15fc9-254c-4a76-9bee-839489da397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:38.539087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a15fc9-254c-4a76-9bee-839489da397f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.539367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a15fc9-254c-4a76-9bee-839489da397f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.539638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a15fc9-254c-4a76-9bee-839489da397f None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.540346 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a15fc9-254c-4a76-9bee-839489da397f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:38.540645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a15fc9-254c-4a76-9bee-839489da397f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:38.542027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a15fc9-254c-4a76-9bee-839489da397f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:38.549202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:38.558698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 286/569] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:38.558698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b736b7-2ba1-42b1-adc7-e18ea0bb09b6 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.558698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b736b7-2ba1-42b1-adc7-e18ea0bb09b6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.558698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b736b7-2ba1-42b1-adc7-e18ea0bb09b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.572137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d3b736b7-2ba1-42b1-adc7-e18ea0bb09b6 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:38.573334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d3b736b7-2ba1-42b1-adc7-e18ea0bb09b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:38.629843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c260b01-701a-489a-8bcb-fcfdf25aa604 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.641351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 287/570] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:38.642646 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a877f-ac8b-4e8c-a692-80881142b5d1 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.642936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a877f-ac8b-4e8c-a692-80881142b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.643246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a877f-ac8b-4e8c-a692-80881142b5d1 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.647130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 288/571] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:38.647130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a877f-ac8b-4e8c-a692-80881142b5d1 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:38.672305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478582c-3333-48ce-b4cf-f886e372315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:38.673024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478582c-3333-48ce-b4cf-f886e372315a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.673301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478582c-3333-48ce-b4cf-f886e372315a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.673850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478582c-3333-48ce-b4cf-f886e372315a None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.674644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478582c-3333-48ce-b4cf-f886e372315a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:38.674946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478582c-3333-48ce-b4cf-f886e372315a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:38.676409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478582c-3333-48ce-b4cf-f886e372315a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:38.688093 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 284/572] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:38.688879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478582c-3333-48ce-b4cf-f886e372315a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:38.733958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:38.761255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a877f-ac8b-4e8c-a692-80881142b5d1 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.788565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:38.793398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478582c-3333-48ce-b4cf-f886e372315a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.797074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a00dd1-96d8-4ab2-a148-73bea0298161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:38.797726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00dd1-96d8-4ab2-a148-73bea0298161 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.798008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00dd1-96d8-4ab2-a148-73bea0298161 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.799777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00dd1-96d8-4ab2-a148-73bea0298161 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.799777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a00dd1-96d8-4ab2-a148-73bea0298161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:38.799777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a00dd1-96d8-4ab2-a148-73bea0298161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:38.800948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a00dd1-96d8-4ab2-a148-73bea0298161 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:38.812478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 289/573] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:38.813923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70586db-14a9-4706-8d00-e212e852270a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.814241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70586db-14a9-4706-8d00-e212e852270a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.814772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70586db-14a9-4706-8d00-e212e852270a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.831080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553064-2033-49dc-9c83-c5ea06d97adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:38.831876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553064-2033-49dc-9c83-c5ea06d97adc None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:38.832161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553064-2033-49dc-9c83-c5ea06d97adc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:38.832256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-c70586db-14a9-4706-8d00-e212e852270a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:38.832447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f553064-2033-49dc-9c83-c5ea06d97adc None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:38.833330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c70586db-14a9-4706-8d00-e212e852270a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:38.839283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553064-2033-49dc-9c83-c5ea06d97adc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:38.841375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f553064-2033-49dc-9c83-c5ea06d97adc None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-3f553064-2033-49dc-9c83-c5ea06d97adc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:38.855824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:38.857653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:38.858569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:38.858569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:38.858569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:38.858569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:38.858569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:38.858569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:38.858569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:38.858569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:38.862445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 285/574] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:38.863158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553064-2033-49dc-9c83-c5ea06d97adc None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:38.899341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 290/575] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:38.900245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70586db-14a9-4706-8d00-e212e852270a None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:38.963793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f553064-2033-49dc-9c83-c5ea06d97adc None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.965379 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:38.998905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70586db-14a9-4706-8d00-e212e852270a None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:38.999699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330f36-c91a-433b-b2a3-5134a47af5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.000499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330f36-c91a-433b-b2a3-5134a47af5c9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.000902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330f36-c91a-433b-b2a3-5134a47af5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.001192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330f36-c91a-433b-b2a3-5134a47af5c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.011983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38330f36-c91a-433b-b2a3-5134a47af5c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:39.016344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-38330f36-c91a-433b-b2a3-5134a47af5c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:39.019752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:39.020839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 286/576] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:39.021862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330f36-c91a-433b-b2a3-5134a47af5c9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:39.035791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b9ebb-e834-45c7-a114-fd77d00ee565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.036447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b9ebb-e834-45c7-a114-fd77d00ee565 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.036742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b9ebb-e834-45c7-a114-fd77d00ee565 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.036997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19b9ebb-e834-45c7-a114-fd77d00ee565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.037827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b9ebb-e834-45c7-a114-fd77d00ee565 None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=d8ea258578544e5c8f05b751d31e0f34) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:39.038129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b9ebb-e834-45c7-a114-fd77d00ee565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:39.039598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19b9ebb-e834-45c7-a114-fd77d00ee565 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:39.045775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 291/577] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:38 2022] GET /identity/v3/role_assignments?user.id=d8ea258578544e5c8f05b751d31e0f34&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:39.046695 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b9ebb-e834-45c7-a114-fd77d00ee565 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:39.138938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330f36-c91a-433b-b2a3-5134a47af5c9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:39.169316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19b9ebb-e834-45c7-a114-fd77d00ee565 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:39.180028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36557a8-5551-43a6-ab1e-aa5096d62cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.181317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36557a8-5551-43a6-ab1e-aa5096d62cb9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.181822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36557a8-5551-43a6-ab1e-aa5096d62cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.182291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36557a8-5551-43a6-ab1e-aa5096d62cb9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.192355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36557a8-5551-43a6-ab1e-aa5096d62cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:39.194325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36557a8-5551-43a6-ab1e-aa5096d62cb9 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:39.206667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa326-57c8-4c9e-bda2-de0c64190177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.207368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa326-57c8-4c9e-bda2-de0c64190177 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.207649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa326-57c8-4c9e-bda2-de0c64190177 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.207923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa326-57c8-4c9e-bda2-de0c64190177 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.208722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaa326-57c8-4c9e-bda2-de0c64190177 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:39.209032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaa326-57c8-4c9e-bda2-de0c64190177 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:39.210486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaa326-57c8-4c9e-bda2-de0c64190177 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-e36557a8-5551-43a6-ab1e-aa5096d62cb9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:39.213019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:39.213959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:39.215111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:39.215111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:39.215111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:39.215111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:39.215111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:39.215111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:39.215111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:39.215111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:39.215111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 13:39:39.215111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:39.217247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 287/578] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:39.218223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36557a8-5551-43a6-ab1e-aa5096d62cb9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:39.229460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 292/579] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:39.230505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa326-57c8-4c9e-bda2-de0c64190177 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:39.252623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:39.277584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:39.335498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa326-57c8-4c9e-bda2-de0c64190177 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:39.342057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36557a8-5551-43a6-ab1e-aa5096d62cb9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:39.372439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fda524-efb5-417d-afbd-5903f8db1d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.373500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fda524-efb5-417d-afbd-5903f8db1d2d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.373927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fda524-efb5-417d-afbd-5903f8db1d2d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.374200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fda524-efb5-417d-afbd-5903f8db1d2d None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.375262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fda524-efb5-417d-afbd-5903f8db1d2d None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:39.375527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fda524-efb5-417d-afbd-5903f8db1d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:39.376878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fda524-efb5-417d-afbd-5903f8db1d2d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:39.377718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db2012-15a6-48a4-a7a4-a418ccccbf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.378517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db2012-15a6-48a4-a7a4-a418ccccbf3b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.378803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db2012-15a6-48a4-a7a4-a418ccccbf3b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.379116 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db2012-15a6-48a4-a7a4-a418ccccbf3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.385281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 293/580] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:39.386308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fda524-efb5-417d-afbd-5903f8db1d2d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:39.394510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db2012-15a6-48a4-a7a4-a418ccccbf3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-93db2012-15a6-48a4-a7a4-a418ccccbf3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:39.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:39.408674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 288/581] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:39.409759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db2012-15a6-48a4-a7a4-a418ccccbf3b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:39.496232 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:39.503819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fda524-efb5-417d-afbd-5903f8db1d2d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:39.510534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:39.520006 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db2012-15a6-48a4-a7a4-a418ccccbf3b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:39.545615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b86b1-573d-4f2c-9a23-59cd2869734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.545615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b86b1-573d-4f2c-9a23-59cd2869734f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.545615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b86b1-573d-4f2c-9a23-59cd2869734f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.545615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b86b1-573d-4f2c-9a23-59cd2869734f None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.546054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b86b1-573d-4f2c-9a23-59cd2869734f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:39.546054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b86b1-573d-4f2c-9a23-59cd2869734f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:39.546054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b86b1-573d-4f2c-9a23-59cd2869734f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:39.557391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6961f3a-de40-4036-98a5-9a32219dbb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.558291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6961f3a-de40-4036-98a5-9a32219dbb37 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.558574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6961f3a-de40-4036-98a5-9a32219dbb37 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.558849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6961f3a-de40-4036-98a5-9a32219dbb37 None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/9a1644fa5cd3499d9d6ad057067255e9/roles/416e51d61cb34bff89839f6703558c2b` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.570166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 294/582] 10.222.0.42 () {56 vars in 1137 bytes} [Fri May 27 13:39:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:39.570166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b86b1-573d-4f2c-9a23-59cd2869734f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:39.576146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6961f3a-de40-4036-98a5-9a32219dbb37 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=9a1644fa5cd3499d9d6ad057067255e9, role_id=416e51d61cb34bff89839f6703558c2b)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:39.577626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6961f3a-de40-4036-98a5-9a32219dbb37 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:39.651410 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 289/583] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:39:39 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/9a1644fa5cd3499d9d6ad057067255e9/roles/416e51d61cb34bff89839f6703558c2b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:39.661330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6961f3a-de40-4036-98a5-9a32219dbb37 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:39.683512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b86b1-573d-4f2c-9a23-59cd2869734f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:39.727267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac86663-2b63-40c8-9a62-800146855cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.728455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86663-2b63-40c8-9a62-800146855cce None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.728931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86663-2b63-40c8-9a62-800146855cce None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.729405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86663-2b63-40c8-9a62-800146855cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.742384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac86663-2b63-40c8-9a62-800146855cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:39.744198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac86663-2b63-40c8-9a62-800146855cce None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-5ac86663-2b63-40c8-9a62-800146855cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:39.765624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:39.766709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:39.767658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:39.767658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:39.767658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:39.767658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:39.774490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 295/584] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:39.775896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac86663-2b63-40c8-9a62-800146855cce None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:39.782196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6961f3a-de40-4036-98a5-9a32219dbb37 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:39.794639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:39.818132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:39.823708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0748de0-8d6d-4162-870b-4d907c5cfe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.824482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0748de0-8d6d-4162-870b-4d907c5cfe62 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.824928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0748de0-8d6d-4162-870b-4d907c5cfe62 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.825272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0748de0-8d6d-4162-870b-4d907c5cfe62 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.826470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0748de0-8d6d-4162-870b-4d907c5cfe62 None admin] RBAC: Adding query filter params (name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:39.827409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0748de0-8d6d-4162-870b-4d907c5cfe62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:39.828668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0748de0-8d6d-4162-870b-4d907c5cfe62 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:39.838369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 290/585] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:39.839358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0748de0-8d6d-4162-870b-4d907c5cfe62 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:39.908016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac86663-2b63-40c8-9a62-800146855cce None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:39.955532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1347a5c-f0d1-4c7c-aafe-a8fbd5796005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.956611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347a5c-f0d1-4c7c-aafe-a8fbd5796005 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:39.956896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347a5c-f0d1-4c7c-aafe-a8fbd5796005 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:39.957176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347a5c-f0d1-4c7c-aafe-a8fbd5796005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:39.958296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0748de0-8d6d-4162-870b-4d907c5cfe62 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:39.971293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1347a5c-f0d1-4c7c-aafe-a8fbd5796005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:39.973311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1347a5c-f0d1-4c7c-aafe-a8fbd5796005 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:39.996552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73641af-1bd5-44a3-a422-a4075cecc95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-d1347a5c-f0d1-4c7c-aafe-a8fbd5796005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:39.997486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:39.998484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:39.999787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:39.999787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:39.999787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:39.999787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:40.000009 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73641af-1bd5-44a3-a422-a4075cecc95a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:40.000009 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73641af-1bd5-44a3-a422-a4075cecc95a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:40.000134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 296/586] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:40.000210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73641af-1bd5-44a3-a422-a4075cecc95a None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:40.000210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73641af-1bd5-44a3-a422-a4075cecc95a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:40.000333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1347a5c-f0d1-4c7c-aafe-a8fbd5796005 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:40.000409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73641af-1bd5-44a3-a422-a4075cecc95a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:40.006335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73641af-1bd5-44a3-a422-a4075cecc95a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:40.021462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 291/587] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:40.022360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73641af-1bd5-44a3-a422-a4075cecc95a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:40.082486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:40.096079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:40.118596 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1347a5c-f0d1-4c7c-aafe-a8fbd5796005 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:40.151639 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73641af-1bd5-44a3-a422-a4075cecc95a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:40.164048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4110-747c-4bc4-98ab-31eb688cf8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:40.165667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4110-747c-4bc4-98ab-31eb688cf8c9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:40.166111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4110-747c-4bc4-98ab-31eb688cf8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:40.166571 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4110-747c-4bc4-98ab-31eb688cf8c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:40.182727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f4110-747c-4bc4-98ab-31eb688cf8c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:40.185030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f4110-747c-4bc4-98ab-31eb688cf8c9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:40.193548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9093d-3caa-4036-8ff6-ed997a16271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:40.194528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9093d-3caa-4036-8ff6-ed997a16271b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:40.194528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9093d-3caa-4036-8ff6-ed997a16271b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:40.194816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9093d-3caa-4036-8ff6-ed997a16271b None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:40.195657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9093d-3caa-4036-8ff6-ed997a16271b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:40.195961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9093d-3caa-4036-8ff6-ed997a16271b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:40.197600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9093d-3caa-4036-8ff6-ed997a16271b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-257f4110-747c-4bc4-98ab-31eb688cf8c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:40.208138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:40.209182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:40.210138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:40.210138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:40.210138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:40.210138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:40.210138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 297/588] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:40.210586 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4110-747c-4bc4-98ab-31eb688cf8c9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:40.216984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 292/589] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:40.218014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9093d-3caa-4036-8ff6-ed997a16271b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:40.358197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f4110-747c-4bc4-98ab-31eb688cf8c9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:40.358638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9093d-3caa-4036-8ff6-ed997a16271b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:40.373969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:40.378096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:40.398157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d65c66-0b46-47cd-b5fb-34f47533a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:40.398591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa285d-1b80-4a19-8e5e-8eef1a81eb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:40.399323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa285d-1b80-4a19-8e5e-8eef1a81eb82 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:40.399606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa285d-1b80-4a19-8e5e-8eef1a81eb82 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:40.399880 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa285d-1b80-4a19-8e5e-8eef1a81eb82 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:40.400224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d65c66-0b46-47cd-b5fb-34f47533a5ad None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:40.400616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa285d-1b80-4a19-8e5e-8eef1a81eb82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:40.400926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa285d-1b80-4a19-8e5e-8eef1a81eb82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:40.401028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d65c66-0b46-47cd-b5fb-34f47533a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:40.401481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d65c66-0b46-47cd-b5fb-34f47533a5ad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:40.402480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa285d-1b80-4a19-8e5e-8eef1a81eb82 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:40.410738 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d65c66-0b46-47cd-b5fb-34f47533a5ad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:40.413031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d65c66-0b46-47cd-b5fb-34f47533a5ad None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:40.420429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 293/590] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:40.421387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa285d-1b80-4a19-8e5e-8eef1a81eb82 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-17d65c66-0b46-47cd-b5fb-34f47533a5ad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:40.432813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:40.433862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:40.434939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:40.434939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:40.434939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:40.434939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:40.434939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:40.434939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:40.434939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:40.434939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:40.434939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 13:39:40.434939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:40.437912 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 298/591] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:40.439324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d65c66-0b46-47cd-b5fb-34f47533a5ad None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:40.547778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa285d-1b80-4a19-8e5e-8eef1a81eb82 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:40.562383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d65c66-0b46-47cd-b5fb-34f47533a5ad None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:40.585486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff2dfe-3ec1-4655-8961-07d465901bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:40.586603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff2dfe-3ec1-4655-8961-07d465901bd8 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:40.587120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff2dfe-3ec1-4655-8961-07d465901bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:40.587576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff2dfe-3ec1-4655-8961-07d465901bd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:40.596298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff2dfe-3ec1-4655-8961-07d465901bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:40.597965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff2dfe-3ec1-4655-8961-07d465901bd8 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:40.601028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84353578-1c98-434d-8ad5-79a53ff43125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:40.601892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353578-1c98-434d-8ad5-79a53ff43125 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:40.602244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353578-1c98-434d-8ad5-79a53ff43125 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:40.602589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353578-1c98-434d-8ad5-79a53ff43125 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:40.613604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84353578-1c98-434d-8ad5-79a53ff43125 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-e9ff2dfe-3ec1-4655-8961-07d465901bd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:40.614392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:40.615288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:40.616209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:40.616209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:40.616209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:40.616209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:40.616209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:40.616209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:40.616209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:40.616209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:40.616653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84353578-1c98-434d-8ad5-79a53ff43125 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:40.623100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 294/592] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:40.624129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff2dfe-3ec1-4655-8961-07d465901bd8 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-84353578-1c98-434d-8ad5-79a53ff43125 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:40.631334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:40.632502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:40.633647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:40.633647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:40.633647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:40.633647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:40.633647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:40.633647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:40.633647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:40.633647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:40.633647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 13:39:40.633647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:40.635621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 299/593] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:40.636570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84353578-1c98-434d-8ad5-79a53ff43125 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:40.680133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:40.704523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:40.750879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff2dfe-3ec1-4655-8961-07d465901bd8 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:40.776344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84353578-1c98-434d-8ad5-79a53ff43125 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:40.786455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187074b-fc77-4978-971b-4346ff58aa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:40.786924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187074b-fc77-4978-971b-4346ff58aa4c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:40.787239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187074b-fc77-4978-971b-4346ff58aa4c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:40.787523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187074b-fc77-4978-971b-4346ff58aa4c None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:40.788370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187074b-fc77-4978-971b-4346ff58aa4c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:40.788683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187074b-fc77-4978-971b-4346ff58aa4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:40.790117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187074b-fc77-4978-971b-4346ff58aa4c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:40.809110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 295/594] 10.222.0.42 () {56 vars in 1137 bytes} [Fri May 27 13:39:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:40.810030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187074b-fc77-4978-971b-4346ff58aa4c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:40.820382 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed422f3-70a6-4db2-802e-d28235ac0fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:40.821446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed422f3-70a6-4db2-802e-d28235ac0fa9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:40.822069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed422f3-70a6-4db2-802e-d28235ac0fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:40.822625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed422f3-70a6-4db2-802e-d28235ac0fa9 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:40.823767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed422f3-70a6-4db2-802e-d28235ac0fa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:40.824339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed422f3-70a6-4db2-802e-d28235ac0fa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:40.826822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed422f3-70a6-4db2-802e-d28235ac0fa9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:40.844166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 300/595] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:40.845487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed422f3-70a6-4db2-802e-d28235ac0fa9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:40.911867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:40.921312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187074b-fc77-4978-971b-4346ff58aa4c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:40.957324 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d11e8d-e88b-4e0f-a9f7-83460279cc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:40.958006 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d11e8d-e88b-4e0f-a9f7-83460279cc2d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:40.958299 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d11e8d-e88b-4e0f-a9f7-83460279cc2d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:40.958571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d11e8d-e88b-4e0f-a9f7-83460279cc2d None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:40.959466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d11e8d-e88b-4e0f-a9f7-83460279cc2d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:40.959781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d11e8d-e88b-4e0f-a9f7-83460279cc2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:40.960957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:40.961222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d11e8d-e88b-4e0f-a9f7-83460279cc2d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:40.966981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed422f3-70a6-4db2-802e-d28235ac0fa9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:40.985068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 296/596] 10.222.0.42 () {56 vars in 1139 bytes} [Fri May 27 13:39:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:40.985068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d11e8d-e88b-4e0f-a9f7-83460279cc2d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:41.009990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f502d-a69f-4b7c-bc85-fe1067849df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:41.011508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f502d-a69f-4b7c-bc85-fe1067849df9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:41.012028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f502d-a69f-4b7c-bc85-fe1067849df9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:41.013240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f502d-a69f-4b7c-bc85-fe1067849df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:41.025036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f502d-a69f-4b7c-bc85-fe1067849df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:41.026850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f502d-a69f-4b7c-bc85-fe1067849df9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-357f502d-a69f-4b7c-bc85-fe1067849df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:41.052305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:41.053231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:41.054119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:41.054119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:41.054119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:41.054119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:41.057308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 301/597] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:41.058371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f502d-a69f-4b7c-bc85-fe1067849df9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:41.096685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d11e8d-e88b-4e0f-a9f7-83460279cc2d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:41.152626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cdf3a-8cd4-4ce1-94a9-d8e8679fae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:41.156170 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cdf3a-8cd4-4ce1-94a9-d8e8679fae10 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:41.156689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cdf3a-8cd4-4ce1-94a9-d8e8679fae10 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:41.157439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cdf3a-8cd4-4ce1-94a9-d8e8679fae10 None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/bbb36541c7ba418a843e5ecbb1f1e337/roles/416e51d61cb34bff89839f6703558c2b` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:41.189784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f502d-a69f-4b7c-bc85-fe1067849df9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:41.189963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cdf3a-8cd4-4ce1-94a9-d8e8679fae10 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=bbb36541c7ba418a843e5ecbb1f1e337, role_id=416e51d61cb34bff89839f6703558c2b)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:41.189963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cdf3a-8cd4-4ce1-94a9-d8e8679fae10 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:41.217671 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0db37-667a-4396-98bc-1cf370089aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:41.218462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0db37-667a-4396-98bc-1cf370089aed None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:41.218748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0db37-667a-4396-98bc-1cf370089aed None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:41.219059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0db37-667a-4396-98bc-1cf370089aed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:41.229802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0db37-667a-4396-98bc-1cf370089aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:41.231292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0db37-667a-4396-98bc-1cf370089aed None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-02e0db37-667a-4396-98bc-1cf370089aed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:41.249906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:41.250904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:41.256717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:41.256717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:41.256717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:41.256717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:41.256717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 302/598] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:41.256717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0db37-667a-4396-98bc-1cf370089aed None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:41.258330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:41.319490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:41.324156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 297/599] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:39:40 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/bbb36541c7ba418a843e5ecbb1f1e337/roles/416e51d61cb34bff89839f6703558c2b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:41.325238 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cdf3a-8cd4-4ce1-94a9-d8e8679fae10 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:41.390309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0db37-667a-4396-98bc-1cf370089aed None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:41.439619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645ac84-d71f-4811-bcc1-4012b76e302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:41.440361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ac84-d71f-4811-bcc1-4012b76e302b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:41.440585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ac84-d71f-4811-bcc1-4012b76e302b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:41.440962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645ac84-d71f-4811-bcc1-4012b76e302b None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:41.441793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645ac84-d71f-4811-bcc1-4012b76e302b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:41.442104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645ac84-d71f-4811-bcc1-4012b76e302b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:41.443552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645ac84-d71f-4811-bcc1-4012b76e302b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:41.453567 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cdf3a-8cd4-4ce1-94a9-d8e8679fae10 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:41.458148 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 303/600] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:41.459652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692e5a-55c7-4987-95c7-b80442585799 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:41.459999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692e5a-55c7-4987-95c7-b80442585799 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:41.460279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b692e5a-55c7-4987-95c7-b80442585799 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:41.461900 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 304/601] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:41.463250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b692e5a-55c7-4987-95c7-b80442585799 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:41.506737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3520b7-6858-453d-a8f6-7a0899d0ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:41.507763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3520b7-6858-453d-a8f6-7a0899d0ccbf None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:41.508050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3520b7-6858-453d-a8f6-7a0899d0ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:41.508326 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3520b7-6858-453d-a8f6-7a0899d0ccbf None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:41.510073 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3520b7-6858-453d-a8f6-7a0899d0ccbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:41.510388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3520b7-6858-453d-a8f6-7a0899d0ccbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:41.511834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3520b7-6858-453d-a8f6-7a0899d0ccbf None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:41.528224 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 298/602] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:41.529684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614d567-45fc-4e5c-8f04-e79e6bdf6cb8 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:41.530474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614d567-45fc-4e5c-8f04-e79e6bdf6cb8 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:41.530763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614d567-45fc-4e5c-8f04-e79e6bdf6cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:41.545181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:41.552124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-7614d567-45fc-4e5c-8f04-e79e6bdf6cb8 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:41.553539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7614d567-45fc-4e5c-8f04-e79e6bdf6cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:41.601115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b692e5a-55c7-4987-95c7-b80442585799 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:41.627223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:41.641624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 299/603] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:41.647032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614d567-45fc-4e5c-8f04-e79e6bdf6cb8 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:41.660715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6c8a1-b9ef-4b5b-a9a8-4b3391762489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:41.661510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6c8a1-b9ef-4b5b-a9a8-4b3391762489 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:41.661793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6c8a1-b9ef-4b5b-a9a8-4b3391762489 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:41.662066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6c8a1-b9ef-4b5b-a9a8-4b3391762489 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:41.677181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6c8a1-b9ef-4b5b-a9a8-4b3391762489 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:41.677181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6c8a1-b9ef-4b5b-a9a8-4b3391762489 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-0ba6c8a1-b9ef-4b5b-a9a8-4b3391762489 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:41.696264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:41.697190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:41.698052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:41.698052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:41.698052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:41.698052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:41.698052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:41.698052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:41.698052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:41.698052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:41.701331 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 305/604] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:41.702359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6c8a1-b9ef-4b5b-a9a8-4b3391762489 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:41.769526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614d567-45fc-4e5c-8f04-e79e6bdf6cb8 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:41.809723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea45ed-3d06-4f27-8c02-6114d59480b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:41.810593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea45ed-3d06-4f27-8c02-6114d59480b6 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:41.810882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea45ed-3d06-4f27-8c02-6114d59480b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:41.811184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea45ed-3d06-4f27-8c02-6114d59480b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:41.818473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6c8a1-b9ef-4b5b-a9a8-4b3391762489 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:41.820794 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea45ed-3d06-4f27-8c02-6114d59480b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:41.822324 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea45ed-3d06-4f27-8c02-6114d59480b6 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-10ea45ed-3d06-4f27-8c02-6114d59480b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:41.837211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:41.838124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:41.839020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:41.839020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:41.839020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:41.839020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:41.839020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:41.839020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:41.839020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:41.839020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:41.843025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 300/605] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:41.843986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea45ed-3d06-4f27-8c02-6114d59480b6 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:41.847800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:41.861142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb7896-e020-4160-9792-9b6a57d3d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:41.862312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb7896-e020-4160-9792-9b6a57d3d4df None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:41.862789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb7896-e020-4160-9792-9b6a57d3d4df None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:41.863286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb7896-e020-4160-9792-9b6a57d3d4df None admin] PATH_INFO: `/v3/roles/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:41.875431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb7896-e020-4160-9792-9b6a57d3d4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-3bdb7896-e020-4160-9792-9b6a57d3d4df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:41.884796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:41.885694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:41.886517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:41.893843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 306/606] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:41.895163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb7896-e020-4160-9792-9b6a57d3d4df None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:41.898592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:41.960735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea45ed-3d06-4f27-8c02-6114d59480b6 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:41.999330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7344e37-b854-4f3c-9bfc-2d296347b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:41.999997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7344e37-b854-4f3c-9bfc-2d296347b0bf None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:42.000778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7344e37-b854-4f3c-9bfc-2d296347b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:42.001065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7344e37-b854-4f3c-9bfc-2d296347b0bf None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:42.001861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7344e37-b854-4f3c-9bfc-2d296347b0bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:42.002172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7344e37-b854-4f3c-9bfc-2d296347b0bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:42.004303 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7344e37-b854-4f3c-9bfc-2d296347b0bf None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:42.017349 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 301/607] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:42.017996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7344e37-b854-4f3c-9bfc-2d296347b0bf None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:42.029787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb7896-e020-4160-9792-9b6a57d3d4df None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:42.070180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d00c5-bb7f-4c3b-b253-b1f93e78537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:42.070840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d00c5-bb7f-4c3b-b253-b1f93e78537d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:42.071151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d00c5-bb7f-4c3b-b253-b1f93e78537d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:42.071422 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d00c5-bb7f-4c3b-b253-b1f93e78537d None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:42.072207 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d00c5-bb7f-4c3b-b253-b1f93e78537d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:42.072501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d00c5-bb7f-4c3b-b253-b1f93e78537d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:42.073911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d00c5-bb7f-4c3b-b253-b1f93e78537d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:42.086386 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 307/608] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:42.088100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f95e5-2042-4499-ac5f-c8999a508726 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:42.088580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f95e5-2042-4499-ac5f-c8999a508726 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:42.089036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f95e5-2042-4499-ac5f-c8999a508726 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:42.091010 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 308/609] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:42.091880 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f95e5-2042-4499-ac5f-c8999a508726 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:42.141099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:42.141451 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7344e37-b854-4f3c-9bfc-2d296347b0bf None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:42.153861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:42.178923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbcc59-238d-4197-8f50-2bfbd1fc0bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:42.179689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbcc59-238d-4197-8f50-2bfbd1fc0bd6 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:42.179973 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbcc59-238d-4197-8f50-2bfbd1fc0bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:42.180316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbcc59-238d-4197-8f50-2bfbd1fc0bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:42.181066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbcc59-238d-4197-8f50-2bfbd1fc0bd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:42.181418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbcc59-238d-4197-8f50-2bfbd1fc0bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:42.182916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbcc59-238d-4197-8f50-2bfbd1fc0bd6 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:42.196981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 302/610] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:42.196981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbcc59-238d-4197-8f50-2bfbd1fc0bd6 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:42.214208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f95e5-2042-4499-ac5f-c8999a508726 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:42.251677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea1e94-4212-4d82-b80e-ad6e5492b85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:42.252880 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea1e94-4212-4d82-b80e-ad6e5492b85b None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:42.253207 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea1e94-4212-4d82-b80e-ad6e5492b85b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:42.253522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea1e94-4212-4d82-b80e-ad6e5492b85b None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/8e3e451167fc4984be9726430f436e40/roles/416e51d61cb34bff89839f6703558c2b` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:42.273178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea1e94-4212-4d82-b80e-ad6e5492b85b None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=8e3e451167fc4984be9726430f436e40, role_id=416e51d61cb34bff89839f6703558c2b)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:42.274623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea1e94-4212-4d82-b80e-ad6e5492b85b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:42.302414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbcc59-238d-4197-8f50-2bfbd1fc0bd6 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:42.334594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c3557-062f-4f65-bed6-78e07ecbcbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:42.335505 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c3557-062f-4f65-bed6-78e07ecbcbe4 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:42.335781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c3557-062f-4f65-bed6-78e07ecbcbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:42.336050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c3557-062f-4f65-bed6-78e07ecbcbe4 None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/7afc19dc502f425faf693eb963fe63d4/roles/416e51d61cb34bff89839f6703558c2b` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:42.350576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c3557-062f-4f65-bed6-78e07ecbcbe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=7afc19dc502f425faf693eb963fe63d4, role_id=416e51d61cb34bff89839f6703558c2b)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:42.352206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c3557-062f-4f65-bed6-78e07ecbcbe4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:42.393892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 309/611] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:39:42 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/8e3e451167fc4984be9726430f436e40/roles/416e51d61cb34bff89839f6703558c2b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:42.395322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a12bb-858e-4902-b4a0-69ac14949d75 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:42.395612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a12bb-858e-4902-b4a0-69ac14949d75 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:42.395887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a12bb-858e-4902-b4a0-69ac14949d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:42.414039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3f0a12bb-858e-4902-b4a0-69ac14949d75 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:42.415340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3f0a12bb-858e-4902-b4a0-69ac14949d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:42.461951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 303/612] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:39:42 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/7afc19dc502f425faf693eb963fe63d4/roles/416e51d61cb34bff89839f6703558c2b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:42.463305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c3557-062f-4f65-bed6-78e07ecbcbe4 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:42.501393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:42.548488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 310/613] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:42.584644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a12bb-858e-4902-b4a0-69ac14949d75 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:42.609334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c3557-062f-4f65-bed6-78e07ecbcbe4 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:42.634475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:42.661389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e71b45-9feb-4257-a58d-687eb880131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:42.662603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e71b45-9feb-4257-a58d-687eb880131a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:42.663145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e71b45-9feb-4257-a58d-687eb880131a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:42.663645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e71b45-9feb-4257-a58d-687eb880131a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:42.681457 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e71b45-9feb-4257-a58d-687eb880131a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:42.683388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e71b45-9feb-4257-a58d-687eb880131a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-e2e71b45-9feb-4257-a58d-687eb880131a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:42.710534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:42.711559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:42.712454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:42.712454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:42.712454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:42.712454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:42.719496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 304/614] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:42.726049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e71b45-9feb-4257-a58d-687eb880131a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:42.750960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a12bb-858e-4902-b4a0-69ac14949d75 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:42.799938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7efd11-b5df-4b8c-91a6-c637ea76eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:42.801359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7efd11-b5df-4b8c-91a6-c637ea76eeba None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:42.802264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7efd11-b5df-4b8c-91a6-c637ea76eeba None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:42.802999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7efd11-b5df-4b8c-91a6-c637ea76eeba None admin] PATH_INFO: `/v3/roles/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:42.816752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:42.823421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7efd11-b5df-4b8c-91a6-c637ea76eeba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-3a7efd11-b5df-4b8c-91a6-c637ea76eeba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:42.834555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:42.836777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:42.837630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:42.839620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 311/615] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:42.846852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e71b45-9feb-4257-a58d-687eb880131a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:42.848018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7efd11-b5df-4b8c-91a6-c637ea76eeba None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:42.923453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a10c1-c99b-456a-8053-34952a5d2c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:42.924506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a10c1-c99b-456a-8053-34952a5d2c75 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:42.924798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a10c1-c99b-456a-8053-34952a5d2c75 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:42.925080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a10c1-c99b-456a-8053-34952a5d2c75 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:42.925823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a10c1-c99b-456a-8053-34952a5d2c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:42.926137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a10c1-c99b-456a-8053-34952a5d2c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:42.927553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a10c1-c99b-456a-8053-34952a5d2c75 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:42.947382 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:42.957051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 305/616] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:42.963497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a10c1-c99b-456a-8053-34952a5d2c75 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:42.967401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7efd11-b5df-4b8c-91a6-c637ea76eeba None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:43.036977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1db39-9d32-4ae0-aeca-ba77f3b7fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:43.038789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1db39-9d32-4ae0-aeca-ba77f3b7fc03 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:43.039121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1db39-9d32-4ae0-aeca-ba77f3b7fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:43.039402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1db39-9d32-4ae0-aeca-ba77f3b7fc03 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:43.040415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1db39-9d32-4ae0-aeca-ba77f3b7fc03 None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:43.040729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1db39-9d32-4ae0-aeca-ba77f3b7fc03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:43.042898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1db39-9d32-4ae0-aeca-ba77f3b7fc03 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:43.054872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 312/617] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:43.061566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1db39-9d32-4ae0-aeca-ba77f3b7fc03 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:43.175663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1db39-9d32-4ae0-aeca-ba77f3b7fc03 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:43.177186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a10c1-c99b-456a-8053-34952a5d2c75 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:43.219941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ab6a5-1151-4857-80f0-5360c2a8f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:43.221202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ab6a5-1151-4857-80f0-5360c2a8f492 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:43.221487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ab6a5-1151-4857-80f0-5360c2a8f492 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:43.221764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ab6a5-1151-4857-80f0-5360c2a8f492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:43.235009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ab6a5-1151-4857-80f0-5360c2a8f492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:43.236852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ab6a5-1151-4857-80f0-5360c2a8f492 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:43.244808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:43.257077 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d62b6-8b74-4539-a26e-ed550ad07759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-d00ab6a5-1151-4857-80f0-5360c2a8f492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:43.258041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:43.259176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:43.260296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:43.260296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:43.260296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:43.260296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:43.260753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d62b6-8b74-4539-a26e-ed550ad07759 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:43.261200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d62b6-8b74-4539-a26e-ed550ad07759 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:43.261620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d62b6-8b74-4539-a26e-ed550ad07759 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:43.262132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 313/618] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:43.267535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ab6a5-1151-4857-80f0-5360c2a8f492 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:43.269667 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:43.283738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d62b6-8b74-4539-a26e-ed550ad07759 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:43.285417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d62b6-8b74-4539-a26e-ed550ad07759 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-ce3d62b6-8b74-4539-a26e-ed550ad07759 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:43.317097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:43.318256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:43.319225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 306/619] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:39:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:43.324026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d62b6-8b74-4539-a26e-ed550ad07759 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:43.393600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ab6a5-1151-4857-80f0-5360c2a8f492 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:43.443695 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b05b5-0b8b-4527-9bbf-cb211b6f62bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:43.444737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b05b5-0b8b-4527-9bbf-cb211b6f62bd None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:43.445232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b05b5-0b8b-4527-9bbf-cb211b6f62bd None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:43.445721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b05b5-0b8b-4527-9bbf-cb211b6f62bd None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:43.446657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b05b5-0b8b-4527-9bbf-cb211b6f62bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:43.448673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b05b5-0b8b-4527-9bbf-cb211b6f62bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:43.450807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b05b5-0b8b-4527-9bbf-cb211b6f62bd None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:43.466199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 314/620] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:43.472323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b05b5-0b8b-4527-9bbf-cb211b6f62bd None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:43.562415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d62b6-8b74-4539-a26e-ed550ad07759 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:43.571611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:43.615886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b05b5-0b8b-4527-9bbf-cb211b6f62bd None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:43.639879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ca2a8-ffbb-4d13-8ef9-c187a61a8e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:43.642717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ca2a8-ffbb-4d13-8ef9-c187a61a8e30 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:43.643020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ca2a8-ffbb-4d13-8ef9-c187a61a8e30 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:43.643303 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ca2a8-ffbb-4d13-8ef9-c187a61a8e30 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:43.644255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ca2a8-ffbb-4d13-8ef9-c187a61a8e30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:43.644562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ca2a8-ffbb-4d13-8ef9-c187a61a8e30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:43.646005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ca2a8-ffbb-4d13-8ef9-c187a61a8e30 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:43.688069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 307/621] 10.222.0.42 () {56 vars in 1135 bytes} [Fri May 27 13:39:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:43.692295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057700f-c514-4bb0-8ea1-c0f59c7ea129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:43.693343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057700f-c514-4bb0-8ea1-c0f59c7ea129 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:43.693743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ca2a8-ffbb-4d13-8ef9-c187a61a8e30 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:43.694064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057700f-c514-4bb0-8ea1-c0f59c7ea129 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:43.694490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057700f-c514-4bb0-8ea1-c0f59c7ea129 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:43.705597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057700f-c514-4bb0-8ea1-c0f59c7ea129 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:43.707832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057700f-c514-4bb0-8ea1-c0f59c7ea129 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-4057700f-c514-4bb0-8ea1-c0f59c7ea129 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:43.724428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:43.725567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:43.726532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:43.726532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:43.726532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:43.726532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:43.726532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:43.726532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:43.726532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:43.726532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:43.726532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 13:39:43.726532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:43.729384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 315/622] 10.222.0.42 () {56 vars in 1093 bytes} [Fri May 27 13:39:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:43.735214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057700f-c514-4bb0-8ea1-c0f59c7ea129 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:43.801415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:43.861063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ca2a8-ffbb-4d13-8ef9-c187a61a8e30 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:43.898021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057700f-c514-4bb0-8ea1-c0f59c7ea129 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:43.900444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf1edb-05f1-4c75-be6c-edc07b169e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:43.901258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf1edb-05f1-4c75-be6c-edc07b169e13 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:43.901530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf1edb-05f1-4c75-be6c-edc07b169e13 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:43.901811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf1edb-05f1-4c75-be6c-edc07b169e13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:43.913540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf1edb-05f1-4c75-be6c-edc07b169e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:43.915049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf1edb-05f1-4c75-be6c-edc07b169e13 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:43.919172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-f1cf1edb-05f1-4c75-be6c-edc07b169e13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:43.935765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:43.936716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:43.937616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:43.937616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:43.937616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:43.937616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:43.937616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 308/623] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:43.938415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2daf9-97fa-4a7f-9a84-9681337f11ea None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:43.943014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2daf9-97fa-4a7f-9a84-9681337f11ea None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:43.943014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2daf9-97fa-4a7f-9a84-9681337f11ea None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:43.943014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 309/624] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:43.943014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2daf9-97fa-4a7f-9a84-9681337f11ea None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:43.951489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7330aba-6c5c-4b75-ab46-1601704228f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:43.955873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7330aba-6c5c-4b75-ab46-1601704228f6 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:43.956417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7330aba-6c5c-4b75-ab46-1601704228f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:43.957490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7330aba-6c5c-4b75-ab46-1601704228f6 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:43.958567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7330aba-6c5c-4b75-ab46-1601704228f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:43.959573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7330aba-6c5c-4b75-ab46-1601704228f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:43.961924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7330aba-6c5c-4b75-ab46-1601704228f6 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:43.986841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 316/625] 10.222.0.42 () {56 vars in 1133 bytes} [Fri May 27 13:39:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:43.989329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fe88b-7582-4fdc-bfe5-4cf971141ae2 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:43.989826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fe88b-7582-4fdc-bfe5-4cf971141ae2 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:43.990321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fe88b-7582-4fdc-bfe5-4cf971141ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:44.011553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8a2fe88b-7582-4fdc-bfe5-4cf971141ae2 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:44.014204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8a2fe88b-7582-4fdc-bfe5-4cf971141ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:44.078286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2daf9-97fa-4a7f-9a84-9681337f11ea None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:44.082210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:44.094069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 317/626] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:44.094069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fe88b-7582-4fdc-bfe5-4cf971141ae2 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:44.134781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf2f68-40a4-4803-960a-aba812d78714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:44.135435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf2f68-40a4-4803-960a-aba812d78714 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:44.135720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf2f68-40a4-4803-960a-aba812d78714 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:44.136000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf2f68-40a4-4803-960a-aba812d78714 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:44.136990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf2f68-40a4-4803-960a-aba812d78714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:44.137845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf2f68-40a4-4803-960a-aba812d78714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:44.139915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf2f68-40a4-4803-960a-aba812d78714 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:44.153237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 310/627] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:44.154435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf2f68-40a4-4803-960a-aba812d78714 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:44.236221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fe88b-7582-4fdc-bfe5-4cf971141ae2 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:44.239783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:44.272696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f9067-f9f5-4d07-9bf1-6137fb85bb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:44.273291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf2f68-40a4-4803-960a-aba812d78714 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:44.274339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f9067-f9f5-4d07-9bf1-6137fb85bb68 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:44.274819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f9067-f9f5-4d07-9bf1-6137fb85bb68 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:44.275360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f9067-f9f5-4d07-9bf1-6137fb85bb68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:44.311057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8b89-a0ae-4589-8a51-62e348125e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:44.312250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8b89-a0ae-4589-8a51-62e348125e41 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:44.312815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8b89-a0ae-4589-8a51-62e348125e41 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:44.313286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8b89-a0ae-4589-8a51-62e348125e41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:44.325051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8b89-a0ae-4589-8a51-62e348125e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-1e6a8b89-a0ae-4589-8a51-62e348125e41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:44.333209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:44.334146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:44.334962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:44.337862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 311/628] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:44.338864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8b89-a0ae-4589-8a51-62e348125e41 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:44.370407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f9067-f9f5-4d07-9bf1-6137fb85bb68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:44.372063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:44.373299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f9067-f9f5-4d07-9bf1-6137fb85bb68 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:44.461112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8b89-a0ae-4589-8a51-62e348125e41 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:44.500696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 318/629] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:44.500696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f9067-f9f5-4d07-9bf1-6137fb85bb68 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:44.500696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:44.507179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf502781-6c78-4f9e-9931-79f4c50039d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:44.508245 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf502781-6c78-4f9e-9931-79f4c50039d5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:44.510422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf502781-6c78-4f9e-9931-79f4c50039d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:44.510422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf502781-6c78-4f9e-9931-79f4c50039d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:44.517309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf502781-6c78-4f9e-9931-79f4c50039d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:44.519134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf502781-6c78-4f9e-9931-79f4c50039d5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-bf502781-6c78-4f9e-9931-79f4c50039d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:44.535908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:44.536832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:44.537709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:44.537709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:44.537709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:44.537709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:44.537709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:44.537709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:44.537709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:44.537709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:44.540246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 312/630] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:44.541230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf502781-6c78-4f9e-9931-79f4c50039d5 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:44.625887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f9067-f9f5-4d07-9bf1-6137fb85bb68 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:44.646313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:44.665103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e238d33-f35c-4997-aa0d-2cf60d10464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:44.666133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238d33-f35c-4997-aa0d-2cf60d10464c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:44.666613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238d33-f35c-4997-aa0d-2cf60d10464c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:44.667158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e238d33-f35c-4997-aa0d-2cf60d10464c None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:44.668109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e238d33-f35c-4997-aa0d-2cf60d10464c None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:44.669370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e238d33-f35c-4997-aa0d-2cf60d10464c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:44.669931 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf502781-6c78-4f9e-9931-79f4c50039d5 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:44.671245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e238d33-f35c-4997-aa0d-2cf60d10464c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:44.682572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 319/631] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:44.683885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e238d33-f35c-4997-aa0d-2cf60d10464c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:44.722717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8ac40-55fb-4b05-a362-43d92f05bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:44.724101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8ac40-55fb-4b05-a362-43d92f05bb75 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:44.724905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8ac40-55fb-4b05-a362-43d92f05bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:44.725705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8ac40-55fb-4b05-a362-43d92f05bb75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:44.739272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8ac40-55fb-4b05-a362-43d92f05bb75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:44.741428 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8ac40-55fb-4b05-a362-43d92f05bb75 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-10c8ac40-55fb-4b05-a362-43d92f05bb75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:44.766932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:44.767927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:44.768825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:44.768825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:44.768825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:44.768825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:44.769062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:44.776622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 313/632] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:44.776622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8ac40-55fb-4b05-a362-43d92f05bb75 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:44.815837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e238d33-f35c-4997-aa0d-2cf60d10464c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:44.853987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee37d1c-8fc1-4b5c-b9e0-f51bde74c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:44.855017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee37d1c-8fc1-4b5c-b9e0-f51bde74c3fc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:44.855519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee37d1c-8fc1-4b5c-b9e0-f51bde74c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:44.856031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee37d1c-8fc1-4b5c-b9e0-f51bde74c3fc None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:44.857249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee37d1c-8fc1-4b5c-b9e0-f51bde74c3fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:44.857761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee37d1c-8fc1-4b5c-b9e0-f51bde74c3fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:44.859838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee37d1c-8fc1-4b5c-b9e0-f51bde74c3fc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:44.875175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 320/633] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:44.876574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee37d1c-8fc1-4b5c-b9e0-f51bde74c3fc None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:44.907040 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8ac40-55fb-4b05-a362-43d92f05bb75 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:44.953805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011a1b8-4cf5-433a-8dad-35fb5fc88e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:44.954993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011a1b8-4cf5-433a-8dad-35fb5fc88e4e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:44.955478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011a1b8-4cf5-433a-8dad-35fb5fc88e4e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:44.955947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011a1b8-4cf5-433a-8dad-35fb5fc88e4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:44.959415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:44.969337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011a1b8-4cf5-433a-8dad-35fb5fc88e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:44.970799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011a1b8-4cf5-433a-8dad-35fb5fc88e4e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-f011a1b8-4cf5-433a-8dad-35fb5fc88e4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:44.989605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:44.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:44.991485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:44.991485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:44.991485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:44.991485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:44.991485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 314/634] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:44.991485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011a1b8-4cf5-433a-8dad-35fb5fc88e4e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:45.008622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee37d1c-8fc1-4b5c-b9e0-f51bde74c3fc None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:45.041437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:45.052545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059a60c-9141-4fb1-86de-52136f02fc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:45.058012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059a60c-9141-4fb1-86de-52136f02fc5b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.058012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059a60c-9141-4fb1-86de-52136f02fc5b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.058012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059a60c-9141-4fb1-86de-52136f02fc5b None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.058012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059a60c-9141-4fb1-86de-52136f02fc5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:45.058012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059a60c-9141-4fb1-86de-52136f02fc5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:45.058012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059a60c-9141-4fb1-86de-52136f02fc5b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:45.075285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 321/635] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:45.075285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f5ab-0c80-494e-bccc-97c42ed4dacc None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.075285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f5ab-0c80-494e-bccc-97c42ed4dacc None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.075285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88f5ab-0c80-494e-bccc-97c42ed4dacc None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.075285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 322/636] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:45.075744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f5ab-0c80-494e-bccc-97c42ed4dacc None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:45.108052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011a1b8-4cf5-433a-8dad-35fb5fc88e4e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:45.142420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565c0bf-cb7c-4c8f-aa2e-4fb5b8369a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:45.143342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565c0bf-cb7c-4c8f-aa2e-4fb5b8369a45 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.143630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565c0bf-cb7c-4c8f-aa2e-4fb5b8369a45 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.143908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565c0bf-cb7c-4c8f-aa2e-4fb5b8369a45 None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/d8ea258578544e5c8f05b751d31e0f34/roles/416e51d61cb34bff89839f6703558c2b` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.158002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565c0bf-cb7c-4c8f-aa2e-4fb5b8369a45 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=d8ea258578544e5c8f05b751d31e0f34, role_id=416e51d61cb34bff89839f6703558c2b)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:45.159495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565c0bf-cb7c-4c8f-aa2e-4fb5b8369a45 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:45.176913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88f5ab-0c80-494e-bccc-97c42ed4dacc None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:45.209989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc611536-a89b-4b5c-b2cc-3ee90e7e1446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:45.210638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc611536-a89b-4b5c-b2cc-3ee90e7e1446 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.210925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc611536-a89b-4b5c-b2cc-3ee90e7e1446 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.211237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc611536-a89b-4b5c-b2cc-3ee90e7e1446 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.211950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc611536-a89b-4b5c-b2cc-3ee90e7e1446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:45.212262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc611536-a89b-4b5c-b2cc-3ee90e7e1446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:45.213633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc611536-a89b-4b5c-b2cc-3ee90e7e1446 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:45.225908 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 323/637] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:45.227131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c60f3-9e1c-429a-909b-f1516dbdf637 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.227419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c60f3-9e1c-429a-909b-f1516dbdf637 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.227696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c60f3-9e1c-429a-909b-f1516dbdf637 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.228920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 324/638] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:45.229615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c60f3-9e1c-429a-909b-f1516dbdf637 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:45.275878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:45.300233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 315/639] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:39:44 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/d8ea258578544e5c8f05b751d31e0f34/roles/416e51d61cb34bff89839f6703558c2b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:45.301539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7df9-010d-4273-bdd3-df8b953b3064 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7df9-010d-4273-bdd3-df8b953b3064 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.302094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe7df9-010d-4273-bdd3-df8b953b3064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.320139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ddfe7df9-010d-4273-bdd3-df8b953b3064 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:45.321359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ddfe7df9-010d-4273-bdd3-df8b953b3064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:45.333780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c60f3-9e1c-429a-909b-f1516dbdf637 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:45.358790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:45.373661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d244087-0e63-4a57-baf1-18972a853dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:45.374470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d244087-0e63-4a57-baf1-18972a853dd8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.374750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d244087-0e63-4a57-baf1-18972a853dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.375062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d244087-0e63-4a57-baf1-18972a853dd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.382395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d244087-0e63-4a57-baf1-18972a853dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:45.383904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d244087-0e63-4a57-baf1-18972a853dd8 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-7d244087-0e63-4a57-baf1-18972a853dd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:45.399870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:45.401004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:45.402082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:45.402082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:45.402082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:45.402082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:45.402082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:45.402082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:45.402082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:45.402082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:45.406276 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 325/640] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:45.407278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d244087-0e63-4a57-baf1-18972a853dd8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:45.415202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 316/641] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:45.417181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20955a9b-d531-41cb-b070-c0f99ecbe5f9 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.417744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20955a9b-d531-41cb-b070-c0f99ecbe5f9 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.418025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20955a9b-d531-41cb-b070-c0f99ecbe5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.440851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-20955a9b-d531-41cb-b070-c0f99ecbe5f9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:45.442210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-20955a9b-d531-41cb-b070-c0f99ecbe5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:45.521094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 317/642] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:45.522282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d244087-0e63-4a57-baf1-18972a853dd8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:45.522633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20955a9b-d531-41cb-b070-c0f99ecbe5f9 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:45.532600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:45.562037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3ff2f-f845-4f44-8cbb-25e1c74d423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:45.562834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3ff2f-f845-4f44-8cbb-25e1c74d423f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.563164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3ff2f-f845-4f44-8cbb-25e1c74d423f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.563463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3ff2f-f845-4f44-8cbb-25e1c74d423f None admin] PATH_INFO: `/v3/users/glance` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.572905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3ff2f-f845-4f44-8cbb-25e1c74d423f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:45.574371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3ff2f-f845-4f44-8cbb-25e1c74d423f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-d4e3ff2f-f845-4f44-8cbb-25e1c74d423f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:45.591111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:45.592275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:45.593249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:45.593249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:45.593249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:45.593249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:45.593249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:45.593249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:45.593249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:45.593249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:45.593249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 13:39:45.593249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:45.594430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 326/643] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:45.594430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3ff2f-f845-4f44-8cbb-25e1c74d423f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:45.638413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:45.643029 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20955a9b-d531-41cb-b070-c0f99ecbe5f9 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:45.689008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e8143-0c06-4a2a-99fe-e3ca0712af11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:45.689707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e8143-0c06-4a2a-99fe-e3ca0712af11 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.689994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e8143-0c06-4a2a-99fe-e3ca0712af11 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.690271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e8143-0c06-4a2a-99fe-e3ca0712af11 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.691100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e8143-0c06-4a2a-99fe-e3ca0712af11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:45.691415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e8143-0c06-4a2a-99fe-e3ca0712af11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:45.692853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e8143-0c06-4a2a-99fe-e3ca0712af11 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:45.705440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 318/644] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:45.706260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e8143-0c06-4a2a-99fe-e3ca0712af11 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:45.713336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3ff2f-f845-4f44-8cbb-25e1c74d423f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:45.748090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716918a5-1f93-4b3e-a0fe-9ac28864643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:45.749032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716918a5-1f93-4b3e-a0fe-9ac28864643b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.749322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716918a5-1f93-4b3e-a0fe-9ac28864643b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.749597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716918a5-1f93-4b3e-a0fe-9ac28864643b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.760244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716918a5-1f93-4b3e-a0fe-9ac28864643b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-716918a5-1f93-4b3e-a0fe-9ac28864643b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:45.768910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:45.770029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:45.771154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:45.772440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 327/645] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:45.773033 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716918a5-1f93-4b3e-a0fe-9ac28864643b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:45.803725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:45.831305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e8143-0c06-4a2a-99fe-e3ca0712af11 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:45.872371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c536f82-19ba-4b27-acce-62fedf9838ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:45.873694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c536f82-19ba-4b27-acce-62fedf9838ef None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.874456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c536f82-19ba-4b27-acce-62fedf9838ef None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.875194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c536f82-19ba-4b27-acce-62fedf9838ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.882549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716918a5-1f93-4b3e-a0fe-9ac28864643b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:45.886740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c536f82-19ba-4b27-acce-62fedf9838ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-3c536f82-19ba-4b27-acce-62fedf9838ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:45.894613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:45.895588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:45.896408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 319/646] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:45.897124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c536f82-19ba-4b27-acce-62fedf9838ef None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:45.922749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f791a5-ff6e-4566-b40e-f77eb56df02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:45.923475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f791a5-ff6e-4566-b40e-f77eb56df02b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:45.923988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f791a5-ff6e-4566-b40e-f77eb56df02b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:45.924213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:45.924370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f791a5-ff6e-4566-b40e-f77eb56df02b None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:45.925110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f791a5-ff6e-4566-b40e-f77eb56df02b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:45.925420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f791a5-ff6e-4566-b40e-f77eb56df02b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:45.926825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f791a5-ff6e-4566-b40e-f77eb56df02b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:45.944627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 328/647] 10.222.0.42 () {56 vars in 1137 bytes} [Fri May 27 13:39:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:45.945439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f791a5-ff6e-4566-b40e-f77eb56df02b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:46.015742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c536f82-19ba-4b27-acce-62fedf9838ef None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:46.039353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:46.052710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d01a7d-f0ce-40d6-8ebe-a388366192fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:46.053372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d01a7d-f0ce-40d6-8ebe-a388366192fa None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:46.053661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d01a7d-f0ce-40d6-8ebe-a388366192fa None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:46.053989 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d01a7d-f0ce-40d6-8ebe-a388366192fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:46.054783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d01a7d-f0ce-40d6-8ebe-a388366192fa None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=9a1644fa5cd3499d9d6ad057067255e9) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:46.055131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d01a7d-f0ce-40d6-8ebe-a388366192fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:46.056572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d01a7d-f0ce-40d6-8ebe-a388366192fa None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:46.057483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f791a5-ff6e-4566-b40e-f77eb56df02b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:46.063596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 320/648] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:45 2022] GET /identity/v3/role_assignments?user.id=9a1644fa5cd3499d9d6ad057067255e9&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:46.071597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d01a7d-f0ce-40d6-8ebe-a388366192fa None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:46.098320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8676c4-25d3-405c-beae-d84da936d166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:46.099252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8676c4-25d3-405c-beae-d84da936d166 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:46.099636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8676c4-25d3-405c-beae-d84da936d166 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:46.100015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8676c4-25d3-405c-beae-d84da936d166 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:46.100882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8676c4-25d3-405c-beae-d84da936d166 None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:46.101872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8676c4-25d3-405c-beae-d84da936d166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:46.103000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8676c4-25d3-405c-beae-d84da936d166 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:46.117647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 329/649] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:46.118781 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8676c4-25d3-405c-beae-d84da936d166 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:46.179897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:46.202733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d01a7d-f0ce-40d6-8ebe-a388366192fa None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:46.233138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8676c4-25d3-405c-beae-d84da936d166 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:46.246289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e4e84-701e-41e0-9925-8326bf2b2310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:46.247713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e4e84-701e-41e0-9925-8326bf2b2310 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:46.248170 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e4e84-701e-41e0-9925-8326bf2b2310 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:46.248603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e4e84-701e-41e0-9925-8326bf2b2310 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:46.249688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e4e84-701e-41e0-9925-8326bf2b2310 None admin] RBAC: Adding query filter params (name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:46.250264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e4e84-701e-41e0-9925-8326bf2b2310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:46.251846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e4e84-701e-41e0-9925-8326bf2b2310 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:46.262623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 321/650] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:46.264099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e4e84-701e-41e0-9925-8326bf2b2310 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:46.273433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d389f-5e67-453c-98b0-14ab81c7478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:46.274549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d389f-5e67-453c-98b0-14ab81c7478f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:46.274698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d389f-5e67-453c-98b0-14ab81c7478f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:46.275088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d389f-5e67-453c-98b0-14ab81c7478f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:46.294220 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:46.366951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d389f-5e67-453c-98b0-14ab81c7478f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:46.368665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d389f-5e67-453c-98b0-14ab81c7478f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:46.394299 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e4e84-701e-41e0-9925-8326bf2b2310 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:46.441690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786b15-d391-4af6-b514-78ffa3af0c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:46.442862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786b15-d391-4af6-b514-78ffa3af0c0e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:46.443239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786b15-d391-4af6-b514-78ffa3af0c0e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:46.443740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7786b15-d391-4af6-b514-78ffa3af0c0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:46.459351 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786b15-d391-4af6-b514-78ffa3af0c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:46.461499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7786b15-d391-4af6-b514-78ffa3af0c0e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:46.465342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:46.485341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 330/651] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-b7786b15-d391-4af6-b514-78ffa3af0c0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:46.485775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:46.486840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:46.487894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:46.487894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:46.487894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:46.487894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:46.488213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d389f-5e67-453c-98b0-14ab81c7478f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:46.491529 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 322/652] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:46.492395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786b15-d391-4af6-b514-78ffa3af0c0e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:46.556237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:46.614169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d389f-5e67-453c-98b0-14ab81c7478f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:46.614907 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7786b15-d391-4af6-b514-78ffa3af0c0e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:46.656250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41455aec-b4da-4a01-a42c-e2c7242be91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:46.656439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5de89-df50-46ca-88b8-4015289c5fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:46.656967 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41455aec-b4da-4a01-a42c-e2c7242be91c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:46.657088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5de89-df50-46ca-88b8-4015289c5fae None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:46.657252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41455aec-b4da-4a01-a42c-e2c7242be91c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:46.657345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5de89-df50-46ca-88b8-4015289c5fae None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:46.657654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41455aec-b4da-4a01-a42c-e2c7242be91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:46.657752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5de89-df50-46ca-88b8-4015289c5fae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:46.671634 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41455aec-b4da-4a01-a42c-e2c7242be91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:46.673105 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41455aec-b4da-4a01-a42c-e2c7242be91c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:46.675263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5de89-df50-46ca-88b8-4015289c5fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:46.676867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5de89-df50-46ca-88b8-4015289c5fae None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-41455aec-b4da-4a01-a42c-e2c7242be91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:46.694253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:46.695337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:46.696407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:46.696407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:46.696407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:46.696407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:46.696407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 331/653] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:46.696683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41455aec-b4da-4a01-a42c-e2c7242be91c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-c7c5de89-df50-46ca-88b8-4015289c5fae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:46.698357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:46.699388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:46.701192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:46.701192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:46.701192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:46.701192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:46.703129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 323/654] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:46.704121 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5de89-df50-46ca-88b8-4015289c5fae None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:46.756895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:46.811301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5de89-df50-46ca-88b8-4015289c5fae None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:46.829717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:46.833857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41455aec-b4da-4a01-a42c-e2c7242be91c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:46.857127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef9a1d-ce6b-49f7-9dab-ec2ab01c860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:46.857970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9a1d-ce6b-49f7-9dab-ec2ab01c860b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:46.858360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9a1d-ce6b-49f7-9dab-ec2ab01c860b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:46.858646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9a1d-ce6b-49f7-9dab-ec2ab01c860b None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:46.859405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef9a1d-ce6b-49f7-9dab-ec2ab01c860b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:46.859881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef9a1d-ce6b-49f7-9dab-ec2ab01c860b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:46.861668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef9a1d-ce6b-49f7-9dab-ec2ab01c860b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:46.872315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a35a4-9c47-4b8f-945f-8db7206e771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:46.873213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a35a4-9c47-4b8f-945f-8db7206e771c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:46.873632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a35a4-9c47-4b8f-945f-8db7206e771c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:46.874042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a35a4-9c47-4b8f-945f-8db7206e771c None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:46.874914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a35a4-9c47-4b8f-945f-8db7206e771c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:46.875396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a35a4-9c47-4b8f-945f-8db7206e771c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:46.876883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 324/655] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:46.877202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a35a4-9c47-4b8f-945f-8db7206e771c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:46.877724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef9a1d-ce6b-49f7-9dab-ec2ab01c860b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:46.898668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 332/656] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:46.898668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a35a4-9c47-4b8f-945f-8db7206e771c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:47.005063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef9a1d-ce6b-49f7-9dab-ec2ab01c860b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:47.016806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:47.044981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c5db7-9cb6-49de-8abb-6d53ea2f5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:47.045653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c5db7-9cb6-49de-8abb-6d53ea2f5c40 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.045932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c5db7-9cb6-49de-8abb-6d53ea2f5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.046206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c5db7-9cb6-49de-8abb-6d53ea2f5c40 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.046939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c5db7-9cb6-49de-8abb-6d53ea2f5c40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:47.047276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c5db7-9cb6-49de-8abb-6d53ea2f5c40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:47.049036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c5db7-9cb6-49de-8abb-6d53ea2f5c40 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:47.063195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 325/657] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:47.064270 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c5db7-9cb6-49de-8abb-6d53ea2f5c40 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:47.148531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a35a4-9c47-4b8f-945f-8db7206e771c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:47.176867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c5db7-9cb6-49de-8abb-6d53ea2f5c40 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:47.185305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47855c04-2928-4306-8d4c-6cfb552084c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:47.186229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47855c04-2928-4306-8d4c-6cfb552084c0 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.186703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47855c04-2928-4306-8d4c-6cfb552084c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.187114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47855c04-2928-4306-8d4c-6cfb552084c0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.195331 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47855c04-2928-4306-8d4c-6cfb552084c0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:47.196929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47855c04-2928-4306-8d4c-6cfb552084c0 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:47.212446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49df005-7606-4f72-bd69-257a581db9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-47855c04-2928-4306-8d4c-6cfb552084c0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:47.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:47.214450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:47.218619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:47.218619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:47.218619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:47.218619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:47.218619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:47.218619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:47.218619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:47.218619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:47.218619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 13:39:47.218619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:47.219606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49df005-7606-4f72-bd69-257a581db9ea None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.219606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49df005-7606-4f72-bd69-257a581db9ea None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.219606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49df005-7606-4f72-bd69-257a581db9ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.222992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 333/658] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:47.222992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47855c04-2928-4306-8d4c-6cfb552084c0 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:47.223303 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49df005-7606-4f72-bd69-257a581db9ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:47.223959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49df005-7606-4f72-bd69-257a581db9ea None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-f49df005-7606-4f72-bd69-257a581db9ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:47.240277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:47.242334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:47.244685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:47.244685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:47.244685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:47.244685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:47.244685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:47.244685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:47.244685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:47.244685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:47.244685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 13:39:47.244685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:47.252668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 326/659] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:47.252905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:47.253408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49df005-7606-4f72-bd69-257a581db9ea None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:47.279817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:47.332029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47855c04-2928-4306-8d4c-6cfb552084c0 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:47.360289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49df005-7606-4f72-bd69-257a581db9ea None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:47.369804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca3058-403c-4dab-aa93-dffe1111ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:47.370604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca3058-403c-4dab-aa93-dffe1111ff86 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.370886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca3058-403c-4dab-aa93-dffe1111ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.371188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca3058-403c-4dab-aa93-dffe1111ff86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.379522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca3058-403c-4dab-aa93-dffe1111ff86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:47.381003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca3058-403c-4dab-aa93-dffe1111ff86 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-61ca3058-403c-4dab-aa93-dffe1111ff86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:47.397269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:47.399520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:47.401659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:47.401659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:47.401659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:47.401659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:47.401659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:47.401659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:47.401659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:47.401659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:47.403318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dff8a4-b1e8-466d-a087-f735a4a77d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:47.403318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff8a4-b1e8-466d-a087-f735a4a77d9b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.403318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff8a4-b1e8-466d-a087-f735a4a77d9b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.403318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff8a4-b1e8-466d-a087-f735a4a77d9b None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.411865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dff8a4-b1e8-466d-a087-f735a4a77d9b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:47.411865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dff8a4-b1e8-466d-a087-f735a4a77d9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:47.411865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dff8a4-b1e8-466d-a087-f735a4a77d9b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:47.412278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 334/660] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:47.412278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca3058-403c-4dab-aa93-dffe1111ff86 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:47.426787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 327/661] 10.222.0.42 () {56 vars in 1139 bytes} [Fri May 27 13:39:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:47.427757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dff8a4-b1e8-466d-a087-f735a4a77d9b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:47.509931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:47.549772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca3058-403c-4dab-aa93-dffe1111ff86 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:47.549954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:47.549954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dff8a4-b1e8-466d-a087-f735a4a77d9b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:47.567345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8212711-bcb0-4a15-b149-82991ed118e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:47.568014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8212711-bcb0-4a15-b149-82991ed118e3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.568293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8212711-bcb0-4a15-b149-82991ed118e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.568565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8212711-bcb0-4a15-b149-82991ed118e3 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.570496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8212711-bcb0-4a15-b149-82991ed118e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:47.570825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8212711-bcb0-4a15-b149-82991ed118e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:47.572265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8212711-bcb0-4a15-b149-82991ed118e3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:47.589343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633e75e-358c-42d0-912d-114b4206391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:47.591131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633e75e-358c-42d0-912d-114b4206391c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.591949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633e75e-358c-42d0-912d-114b4206391c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.592480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633e75e-358c-42d0-912d-114b4206391c None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.593556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633e75e-358c-42d0-912d-114b4206391c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:47.593990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 335/662] 10.222.0.42 () {56 vars in 1137 bytes} [Fri May 27 13:39:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:47.594379 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633e75e-358c-42d0-912d-114b4206391c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:47.594913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8212711-bcb0-4a15-b149-82991ed118e3 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:47.596358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633e75e-358c-42d0-912d-114b4206391c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:47.609344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 328/663] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:47.610500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41319b-b149-4923-8687-97c49a86ee1c None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.610792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41319b-b149-4923-8687-97c49a86ee1c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.615052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41319b-b149-4923-8687-97c49a86ee1c None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.615052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 329/664] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:47.615052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41319b-b149-4923-8687-97c49a86ee1c None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:47.711793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8212711-bcb0-4a15-b149-82991ed118e3 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:47.742593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41319b-b149-4923-8687-97c49a86ee1c None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:47.751678 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d638f-f705-4da6-b3e8-10a70657b331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:47.752325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d638f-f705-4da6-b3e8-10a70657b331 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.752607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d638f-f705-4da6-b3e8-10a70657b331 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.752886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d638f-f705-4da6-b3e8-10a70657b331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.757306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:47.778805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bf89d-c986-4fa1-a63d-ed88c2adf9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:47.779478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bf89d-c986-4fa1-a63d-ed88c2adf9b3 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.779759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bf89d-c986-4fa1-a63d-ed88c2adf9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.780036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bf89d-c986-4fa1-a63d-ed88c2adf9b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.797097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:47.824510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d638f-f705-4da6-b3e8-10a70657b331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:47.826674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d638f-f705-4da6-b3e8-10a70657b331 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:47.858335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bf89d-c986-4fa1-a63d-ed88c2adf9b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:47.859726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bf89d-c986-4fa1-a63d-ed88c2adf9b3 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:47.933663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 336/665] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:47.934554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d638f-f705-4da6-b3e8-10a70657b331 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:47.977622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:47.978459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 330/666] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:47.980016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c8959-d77b-4320-bf3b-466e3dd389a3 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:47.980459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c8959-d77b-4320-bf3b-466e3dd389a3 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:47.980955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c8959-d77b-4320-bf3b-466e3dd389a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:47.998006 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-b08c8959-d77b-4320-bf3b-466e3dd389a3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:47.999588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b08c8959-d77b-4320-bf3b-466e3dd389a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:48.040651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d638f-f705-4da6-b3e8-10a70657b331 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:48.048049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:48.083068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 331/667] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:48.083068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c8959-d77b-4320-bf3b-466e3dd389a3 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:48.083728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb34c5-9f0e-4fd5-869a-18c2564e619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:48.083728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb34c5-9f0e-4fd5-869a-18c2564e619b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.083728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb34c5-9f0e-4fd5-869a-18c2564e619b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.083973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb34c5-9f0e-4fd5-869a-18c2564e619b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.085737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb34c5-9f0e-4fd5-869a-18c2564e619b None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=bbb36541c7ba418a843e5ecbb1f1e337) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:48.085968 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb34c5-9f0e-4fd5-869a-18c2564e619b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:48.088397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb34c5-9f0e-4fd5-869a-18c2564e619b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:48.097858 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 337/668] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:47 2022] GET /identity/v3/role_assignments?user.id=bbb36541c7ba418a843e5ecbb1f1e337&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:48.098695 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb34c5-9f0e-4fd5-869a-18c2564e619b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:48.211781 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:48.216221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb34c5-9f0e-4fd5-869a-18c2564e619b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:48.230105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c8959-d77b-4320-bf3b-466e3dd389a3 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:48.264243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495d642-3e3b-4699-bd6a-e253eeb0b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:48.265092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495d642-3e3b-4699-bd6a-e253eeb0b819 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.265380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495d642-3e3b-4699-bd6a-e253eeb0b819 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.265663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495d642-3e3b-4699-bd6a-e253eeb0b819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.274472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a5c4a-744c-4c6a-b75e-f177efb06655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:48.275735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a5c4a-744c-4c6a-b75e-f177efb06655 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.276353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a5c4a-744c-4c6a-b75e-f177efb06655 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.276834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a5c4a-744c-4c6a-b75e-f177efb06655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.279729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495d642-3e3b-4699-bd6a-e253eeb0b819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:48.281876 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495d642-3e3b-4699-bd6a-e253eeb0b819 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:48.289694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a5c4a-744c-4c6a-b75e-f177efb06655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:48.291538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a5c4a-744c-4c6a-b75e-f177efb06655 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-f495d642-3e3b-4699-bd6a-e253eeb0b819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:48.305884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:48.306812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:48.308035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:48.308035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:48.308035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:48.308035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:48.308035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 338/669] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:48.308306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495d642-3e3b-4699-bd6a-e253eeb0b819 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-f59a5c4a-744c-4c6a-b75e-f177efb06655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:48.314214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:48.315361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:48.316247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:48.316247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:48.316247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:48.316247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:48.319577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 332/670] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:48.320734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a5c4a-744c-4c6a-b75e-f177efb06655 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:48.367837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:48.449010 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495d642-3e3b-4699-bd6a-e253eeb0b819 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:48.461994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a5c4a-744c-4c6a-b75e-f177efb06655 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:48.487481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689aac8-c53b-4acb-9ea4-37492a8bf157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:48.488389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689aac8-c53b-4acb-9ea4-37492a8bf157 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.488675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689aac8-c53b-4acb-9ea4-37492a8bf157 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.488952 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689aac8-c53b-4acb-9ea4-37492a8bf157 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.499876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd93678-7d9d-4bca-ba22-b9d6b79b0ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:48.500856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd93678-7d9d-4bca-ba22-b9d6b79b0ab4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.500966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689aac8-c53b-4acb-9ea4-37492a8bf157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:48.501460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd93678-7d9d-4bca-ba22-b9d6b79b0ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.501968 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd93678-7d9d-4bca-ba22-b9d6b79b0ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.502902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd93678-7d9d-4bca-ba22-b9d6b79b0ab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:48.503440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd93678-7d9d-4bca-ba22-b9d6b79b0ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:48.505019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd93678-7d9d-4bca-ba22-b9d6b79b0ab4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-6689aac8-c53b-4acb-9ea4-37492a8bf157 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:48.508883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:48.509822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:48.510667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:48.515674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 339/671] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:48.516669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689aac8-c53b-4acb-9ea4-37492a8bf157 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:48.522056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 333/672] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:48.523175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd93678-7d9d-4bca-ba22-b9d6b79b0ab4 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:48.534067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:48.617136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:48.626017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689aac8-c53b-4acb-9ea4-37492a8bf157 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:48.629660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd93678-7d9d-4bca-ba22-b9d6b79b0ab4 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:48.667070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419ce47-f5c1-4f7d-a360-2bd011f05a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:48.667734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419ce47-f5c1-4f7d-a360-2bd011f05a84 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.668062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419ce47-f5c1-4f7d-a360-2bd011f05a84 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.668378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419ce47-f5c1-4f7d-a360-2bd011f05a84 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.671525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03237b-29e3-4db9-8728-872de1219542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:48.671682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419ce47-f5c1-4f7d-a360-2bd011f05a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:48.671682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419ce47-f5c1-4f7d-a360-2bd011f05a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:48.671836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03237b-29e3-4db9-8728-872de1219542 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.671836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03237b-29e3-4db9-8728-872de1219542 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.671836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03237b-29e3-4db9-8728-872de1219542 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.671836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03237b-29e3-4db9-8728-872de1219542 None admin] RBAC: Adding query filter params (name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:48.672069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419ce47-f5c1-4f7d-a360-2bd011f05a84 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:48.672146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03237b-29e3-4db9-8728-872de1219542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:48.672600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f03237b-29e3-4db9-8728-872de1219542 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:48.685818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 334/673] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:48.685818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886ae3-51f5-4482-9622-dabe695082d4 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.685818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886ae3-51f5-4482-9622-dabe695082d4 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.685818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886ae3-51f5-4482-9622-dabe695082d4 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.685818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 335/674] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:48.685818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b886ae3-51f5-4482-9622-dabe695082d4 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:48.691155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 340/675] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:48.695558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419ce47-f5c1-4f7d-a360-2bd011f05a84 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:48.771367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:48.796269 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b886ae3-51f5-4482-9622-dabe695082d4 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:48.802312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419ce47-f5c1-4f7d-a360-2bd011f05a84 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:48.831558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42991f3-a772-4afa-99b2-2d1da0112566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:48.832448 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42991f3-a772-4afa-99b2-2d1da0112566 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.832803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42991f3-a772-4afa-99b2-2d1da0112566 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.833157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42991f3-a772-4afa-99b2-2d1da0112566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.838990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0eb418-8cb2-4083-9660-1393bc40f475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:48.840115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0eb418-8cb2-4083-9660-1393bc40f475 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.840338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42991f3-a772-4afa-99b2-2d1da0112566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:48.840558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0eb418-8cb2-4083-9660-1393bc40f475 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.840891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0eb418-8cb2-4083-9660-1393bc40f475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.842210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42991f3-a772-4afa-99b2-2d1da0112566 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:48.851827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0eb418-8cb2-4083-9660-1393bc40f475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:48.853316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0eb418-8cb2-4083-9660-1393bc40f475 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-b42991f3-a772-4afa-99b2-2d1da0112566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:48.856827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:48.857820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:48.859025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:48.859025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:48.859025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:48.859025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:48.859025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:48.859025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:48.859025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:48.859025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:48.864678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 336/676] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:48.864678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974b02a-efee-4857-b434-a1788472cdae None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:48.864678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974b02a-efee-4857-b434-a1788472cdae None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:48.864678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974b02a-efee-4857-b434-a1788472cdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-fc0eb418-8cb2-4083-9660-1393bc40f475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:48.877089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:48.877988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:48.879529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:48.879529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:48.879529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:48.879529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:48.879529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 341/677] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:48.879801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0eb418-8cb2-4083-9660-1393bc40f475 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:48.883538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-b974b02a-efee-4857-b434-a1788472cdae None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:48.884749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b974b02a-efee-4857-b434-a1788472cdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:48.889787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:48.971386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 337/678] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:48.971386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974b02a-efee-4857-b434-a1788472cdae None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:49.001513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0eb418-8cb2-4083-9660-1393bc40f475 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:49.032267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:49.042852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c06c32-ced1-437e-9b25-b2da99e4e02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:49.043710 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c06c32-ced1-437e-9b25-b2da99e4e02e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:49.043960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c06c32-ced1-437e-9b25-b2da99e4e02e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:49.044321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c06c32-ced1-437e-9b25-b2da99e4e02e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:49.052232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c06c32-ced1-437e-9b25-b2da99e4e02e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:49.056844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c06c32-ced1-437e-9b25-b2da99e4e02e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-a0c06c32-ced1-437e-9b25-b2da99e4e02e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:49.068385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:49.069326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:49.070248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:49.070248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:49.070248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:49.070248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:49.070248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:49.070248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:49.070248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:49.070248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:49.070676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974b02a-efee-4857-b434-a1788472cdae None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:49.074377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 342/679] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:49.075941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c06c32-ced1-437e-9b25-b2da99e4e02e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:49.106867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1807f-38fb-42db-a6d0-051b62b012ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:49.107873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1807f-38fb-42db-a6d0-051b62b012ba None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:49.108161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1807f-38fb-42db-a6d0-051b62b012ba None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:49.108445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1807f-38fb-42db-a6d0-051b62b012ba None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:49.109502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1807f-38fb-42db-a6d0-051b62b012ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:49.109816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1807f-38fb-42db-a6d0-051b62b012ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:49.111978 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1807f-38fb-42db-a6d0-051b62b012ba None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:49.123205 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:49.134452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 338/680] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:49.134452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1807f-38fb-42db-a6d0-051b62b012ba None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:49.184081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c06c32-ced1-437e-9b25-b2da99e4e02e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:49.220592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f74264-9934-49bc-a984-06d439ca8304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:49.221483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74264-9934-49bc-a984-06d439ca8304 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:49.223018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74264-9934-49bc-a984-06d439ca8304 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:49.223018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f74264-9934-49bc-a984-06d439ca8304 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:49.223018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f74264-9934-49bc-a984-06d439ca8304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:49.223645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f74264-9934-49bc-a984-06d439ca8304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:49.225211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f74264-9934-49bc-a984-06d439ca8304 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:49.242792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 343/681] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:49.242991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1807f-38fb-42db-a6d0-051b62b012ba None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:49.243092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f74264-9934-49bc-a984-06d439ca8304 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:49.277142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee7b30-9d01-4a7e-8107-482a727aac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:49.278572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee7b30-9d01-4a7e-8107-482a727aac8e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:49.278917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee7b30-9d01-4a7e-8107-482a727aac8e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:49.279302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee7b30-9d01-4a7e-8107-482a727aac8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:49.289431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee7b30-9d01-4a7e-8107-482a727aac8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:49.291434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-b2ee7b30-9d01-4a7e-8107-482a727aac8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:49.297850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:49.299276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 339/682] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:49.305102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee7b30-9d01-4a7e-8107-482a727aac8e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:49.358097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f74264-9934-49bc-a984-06d439ca8304 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:49.364127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:49.397459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d7be-61d9-442e-b468-90ef3fac046f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:49.398158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d7be-61d9-442e-b468-90ef3fac046f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:49.398502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d7be-61d9-442e-b468-90ef3fac046f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:49.398839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d7be-61d9-442e-b468-90ef3fac046f None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:49.399713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d7be-61d9-442e-b468-90ef3fac046f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:49.400090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d7be-61d9-442e-b468-90ef3fac046f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:49.401705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986d7be-61d9-442e-b468-90ef3fac046f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:49.410957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee7b30-9d01-4a7e-8107-482a727aac8e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:49.422708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 344/683] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:49.422708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d7be-61d9-442e-b468-90ef3fac046f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:49.464234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ac41e-0a63-480a-96db-fa46c57aa121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:49.464895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ac41e-0a63-480a-96db-fa46c57aa121 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:49.465187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ac41e-0a63-480a-96db-fa46c57aa121 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:49.465631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ac41e-0a63-480a-96db-fa46c57aa121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:49.467037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ac41e-0a63-480a-96db-fa46c57aa121 None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=8e3e451167fc4984be9726430f436e40) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:49.467725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ac41e-0a63-480a-96db-fa46c57aa121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:49.469184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ac41e-0a63-480a-96db-fa46c57aa121 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:49.476478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 340/684] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:49 2022] GET /identity/v3/role_assignments?user.id=8e3e451167fc4984be9726430f436e40&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:49.477269 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ac41e-0a63-480a-96db-fa46c57aa121 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:49.540038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d7be-61d9-442e-b468-90ef3fac046f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:49.544587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:49.580972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e8100-85f2-4533-818e-3416ddc3fa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:49.582175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e8100-85f2-4533-818e-3416ddc3fa51 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:49.582767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e8100-85f2-4533-818e-3416ddc3fa51 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:49.583552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e8100-85f2-4533-818e-3416ddc3fa51 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:49.595652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e8100-85f2-4533-818e-3416ddc3fa51 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:49.597669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e8100-85f2-4533-818e-3416ddc3fa51 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-d78e8100-85f2-4533-818e-3416ddc3fa51 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:49.619750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:49.620772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:49.622074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:49.622074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:49.622074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:49.622074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:49.622074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:49.622074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:49.622074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:49.622074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:49.622074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 13:39:49.622074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:49.631833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 345/685] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:39:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:49.631833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e8100-85f2-4533-818e-3416ddc3fa51 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:49.652292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ac41e-0a63-480a-96db-fa46c57aa121 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:49.689514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:49.708528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070c557-e50c-4d82-a240-8b34327fec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:49.709366 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070c557-e50c-4d82-a240-8b34327fec29 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:49.709742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070c557-e50c-4d82-a240-8b34327fec29 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:49.710118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070c557-e50c-4d82-a240-8b34327fec29 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:49.711002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070c557-e50c-4d82-a240-8b34327fec29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:49.711415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070c557-e50c-4d82-a240-8b34327fec29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:49.712932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070c557-e50c-4d82-a240-8b34327fec29 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:49.728361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 341/686] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:49.731304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070c557-e50c-4d82-a240-8b34327fec29 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:49.759635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e8100-85f2-4533-818e-3416ddc3fa51 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:49.818514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbf353-b5b9-459d-9300-28b1138374d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:49.819648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbf353-b5b9-459d-9300-28b1138374d3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:49.820131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbf353-b5b9-459d-9300-28b1138374d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:49.820654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbf353-b5b9-459d-9300-28b1138374d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:49.821680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbf353-b5b9-459d-9300-28b1138374d3 None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=7afc19dc502f425faf693eb963fe63d4) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:49.822308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbf353-b5b9-459d-9300-28b1138374d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:49.824246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbf353-b5b9-459d-9300-28b1138374d3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:49.839250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 346/687] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:49 2022] GET /identity/v3/role_assignments?user.id=7afc19dc502f425faf693eb963fe63d4&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:49.840875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbf353-b5b9-459d-9300-28b1138374d3 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:49.878905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070c557-e50c-4d82-a240-8b34327fec29 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:49.912061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:49.933444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f25038-24e6-403c-8db6-33bb7afa53fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:49.934412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f25038-24e6-403c-8db6-33bb7afa53fb None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:49.934871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f25038-24e6-403c-8db6-33bb7afa53fb None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:49.935316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f25038-24e6-403c-8db6-33bb7afa53fb None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:49.936399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f25038-24e6-403c-8db6-33bb7afa53fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:49.936852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f25038-24e6-403c-8db6-33bb7afa53fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:49.938908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f25038-24e6-403c-8db6-33bb7afa53fb None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:49.966206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 342/688] 10.222.0.42 () {56 vars in 1135 bytes} [Fri May 27 13:39:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:49.973304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f25038-24e6-403c-8db6-33bb7afa53fb None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:50.040876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:50.108262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbf353-b5b9-459d-9300-28b1138374d3 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:50.116274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f25038-24e6-403c-8db6-33bb7afa53fb None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:50.164682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d2263-9985-4d5c-883c-3d697bc43685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:50.165414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d2263-9985-4d5c-883c-3d697bc43685 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:50.165696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d2263-9985-4d5c-883c-3d697bc43685 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:50.166065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d2263-9985-4d5c-883c-3d697bc43685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:50.184537 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d2263-9985-4d5c-883c-3d697bc43685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:50.186207 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d2263-9985-4d5c-883c-3d697bc43685 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:50.186350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d87fa-a6a1-4cd7-9b59-f11fdafe594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:50.187276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d87fa-a6a1-4cd7-9b59-f11fdafe594c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:50.187732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d87fa-a6a1-4cd7-9b59-f11fdafe594c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:50.188290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d87fa-a6a1-4cd7-9b59-f11fdafe594c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-b48d2263-9985-4d5c-883c-3d697bc43685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:50.208397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:50.209345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:50.210234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:50.210234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:50.210234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:50.210234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:50.210234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 347/689] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:50.216937 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d2263-9985-4d5c-883c-3d697bc43685 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:50.319840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d87fa-a6a1-4cd7-9b59-f11fdafe594c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:50.321366 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d87fa-a6a1-4cd7-9b59-f11fdafe594c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:50.347297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:50.369963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d2263-9985-4d5c-883c-3d697bc43685 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:50.415467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934282d-6dd1-4dfd-b36d-5afffbefeea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:50.416060 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934282d-6dd1-4dfd-b36d-5afffbefeea6 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:50.416342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934282d-6dd1-4dfd-b36d-5afffbefeea6 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:50.416618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934282d-6dd1-4dfd-b36d-5afffbefeea6 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:50.417350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934282d-6dd1-4dfd-b36d-5afffbefeea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:50.417657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934282d-6dd1-4dfd-b36d-5afffbefeea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:50.419200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934282d-6dd1-4dfd-b36d-5afffbefeea6 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:50.440722 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:50.452986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 348/690] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:50.461481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934282d-6dd1-4dfd-b36d-5afffbefeea6 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:50.566962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 343/691] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:50.568516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d87fa-a6a1-4cd7-9b59-f11fdafe594c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:50.686356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934282d-6dd1-4dfd-b36d-5afffbefeea6 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:50.697380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d87fa-a6a1-4cd7-9b59-f11fdafe594c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:50.736440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba4554-f5e0-40a7-ab71-ec42afc0b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:50.737000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca972ae8-74de-479a-9480-f7d9f8c8470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:50.737227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba4554-f5e0-40a7-ab71-ec42afc0b075 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:50.737507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba4554-f5e0-40a7-ab71-ec42afc0b075 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:50.737783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba4554-f5e0-40a7-ab71-ec42afc0b075 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:50.738459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972ae8-74de-479a-9480-f7d9f8c8470e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:50.738878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972ae8-74de-479a-9480-f7d9f8c8470e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:50.739338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca972ae8-74de-479a-9480-f7d9f8c8470e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:50.747479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba4554-f5e0-40a7-ab71-ec42afc0b075 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:50.749926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba4554-f5e0-40a7-ab71-ec42afc0b075 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:50.750783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca972ae8-74de-479a-9480-f7d9f8c8470e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:50.752409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca972ae8-74de-479a-9480-f7d9f8c8470e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:50.752765 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:50.756202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-10ba4554-f5e0-40a7-ab71-ec42afc0b075 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:50.768473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:50.769613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:50.770687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 349/692] 10.222.0.42 () {56 vars in 1093 bytes} [Fri May 27 13:39:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:50.771298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdaf26-552c-48c4-84e9-91e957bc7f5d None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:50.775996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdaf26-552c-48c4-84e9-91e957bc7f5d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:50.775996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdaf26-552c-48c4-84e9-91e957bc7f5d None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:50.777207 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 350/693] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:50.778567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdaf26-552c-48c4-84e9-91e957bc7f5d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-ca972ae8-74de-479a-9480-f7d9f8c8470e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:50.781684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:50.782666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:50.783589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:50.783589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:50.783589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:50.783589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:50.785597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 344/694] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:50.791193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c0a75-8045-4d56-ad3d-b0928a541d75 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:50.791948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c0a75-8045-4d56-ad3d-b0928a541d75 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:50.792384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c0a75-8045-4d56-ad3d-b0928a541d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:50.810117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-580c0a75-8045-4d56-ad3d-b0928a541d75 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:50.811596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-580c0a75-8045-4d56-ad3d-b0928a541d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:50.895146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 345/695] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:50.896301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c0a75-8045-4d56-ad3d-b0928a541d75 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:50.911472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdaf26-552c-48c4-84e9-91e957bc7f5d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:50.956467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218197b0-2c64-49f7-93df-abcdf1596b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:50.957063 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218197b0-2c64-49f7-93df-abcdf1596b41 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:50.957344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218197b0-2c64-49f7-93df-abcdf1596b41 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:50.957615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218197b0-2c64-49f7-93df-abcdf1596b41 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:50.958453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218197b0-2c64-49f7-93df-abcdf1596b41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:50.959105 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218197b0-2c64-49f7-93df-abcdf1596b41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:50.962441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218197b0-2c64-49f7-93df-abcdf1596b41 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:50.985998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 351/696] 10.222.0.42 () {56 vars in 1133 bytes} [Fri May 27 13:39:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:50.986932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218197b0-2c64-49f7-93df-abcdf1596b41 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:51.034814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c0a75-8045-4d56-ad3d-b0928a541d75 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:51.052302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:51.072401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:51.082421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd37e8f-7027-42e8-b3ae-decd36a8a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:51.083339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd37e8f-7027-42e8-b3ae-decd36a8a966 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:51.083766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd37e8f-7027-42e8-b3ae-decd36a8a966 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:51.084184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd37e8f-7027-42e8-b3ae-decd36a8a966 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:51.085065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd37e8f-7027-42e8-b3ae-decd36a8a966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:51.085514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd37e8f-7027-42e8-b3ae-decd36a8a966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:51.087048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd37e8f-7027-42e8-b3ae-decd36a8a966 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:51.100701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 346/697] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:51.101803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd37e8f-7027-42e8-b3ae-decd36a8a966 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:51.111478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218197b0-2c64-49f7-93df-abcdf1596b41 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:51.147942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cae42a-5167-463e-888f-1e55b7afe59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:51.149036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cae42a-5167-463e-888f-1e55b7afe59c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:51.149535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cae42a-5167-463e-888f-1e55b7afe59c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:51.149979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cae42a-5167-463e-888f-1e55b7afe59c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:51.160490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cae42a-5167-463e-888f-1e55b7afe59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:51.162173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cae42a-5167-463e-888f-1e55b7afe59c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-62cae42a-5167-463e-888f-1e55b7afe59c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:51.185761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:51.186662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:51.187740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:51.187740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:51.187740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:51.187740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:51.191150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 352/698] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:51.192283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cae42a-5167-463e-888f-1e55b7afe59c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:51.236582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd37e8f-7027-42e8-b3ae-decd36a8a966 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:51.280468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bb0f1-649c-4c93-93d1-230f950fecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:51.281614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bb0f1-649c-4c93-93d1-230f950fecfa None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:51.282135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bb0f1-649c-4c93-93d1-230f950fecfa None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:51.282709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581bb0f1-649c-4c93-93d1-230f950fecfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:51.312640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cae42a-5167-463e-888f-1e55b7afe59c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:51.325888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:51.352992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f0904-a05b-4cc7-9000-a7679de43b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:51.353793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f0904-a05b-4cc7-9000-a7679de43b1f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:51.354073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f0904-a05b-4cc7-9000-a7679de43b1f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:51.354345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f0904-a05b-4cc7-9000-a7679de43b1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:51.363002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f0904-a05b-4cc7-9000-a7679de43b1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:51.364540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f0904-a05b-4cc7-9000-a7679de43b1f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ef5f0904-a05b-4cc7-9000-a7679de43b1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:51.380628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:51.381579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:51.382529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:51.382529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:51.382529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:51.382529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:51.382529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:51.382529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:51.382529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:51.382529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:51.386667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 353/699] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:51.387896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f0904-a05b-4cc7-9000-a7679de43b1f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:51.482215 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:51.496935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bb0f1-649c-4c93-93d1-230f950fecfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:51.498776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581bb0f1-649c-4c93-93d1-230f950fecfa None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:51.503809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f0904-a05b-4cc7-9000-a7679de43b1f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:51.541008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41605c-5684-493b-837f-aca43f17b92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:51.541673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41605c-5684-493b-837f-aca43f17b92a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:51.541954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41605c-5684-493b-837f-aca43f17b92a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:51.542229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41605c-5684-493b-837f-aca43f17b92a None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:51.543085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41605c-5684-493b-837f-aca43f17b92a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:51.543424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41605c-5684-493b-837f-aca43f17b92a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:51.545041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41605c-5684-493b-837f-aca43f17b92a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:51.564841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 354/700] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:51.565859 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41605c-5684-493b-837f-aca43f17b92a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:51.599301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:51.611712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 347/701] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:51.613173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bb0f1-649c-4c93-93d1-230f950fecfa None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:51.695546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41605c-5684-493b-837f-aca43f17b92a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:51.709833 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:51.726058 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581bb0f1-649c-4c93-93d1-230f950fecfa None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:51.738218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07751-be6f-4336-8835-05693fcf4346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:51.738889 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07751-be6f-4336-8835-05693fcf4346 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:51.739202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07751-be6f-4336-8835-05693fcf4346 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:51.739474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07751-be6f-4336-8835-05693fcf4346 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:51.740318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed07751-be6f-4336-8835-05693fcf4346 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:51.740607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed07751-be6f-4336-8835-05693fcf4346 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:51.742034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed07751-be6f-4336-8835-05693fcf4346 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:51.762237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 355/702] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:51.763399 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07751-be6f-4336-8835-05693fcf4346 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:51.769252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbadfb-0346-4870-b41e-a67327fa463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:51.770270 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbadfb-0346-4870-b41e-a67327fa463f None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:51.770748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbadfb-0346-4870-b41e-a67327fa463f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:51.771366 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbadfb-0346-4870-b41e-a67327fa463f None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:51.772264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbadfb-0346-4870-b41e-a67327fa463f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:51.774027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbadfb-0346-4870-b41e-a67327fa463f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:51.857645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 348/703] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:39:51 2022] POST /identity/v3/users => generated 254 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:39:51.857645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbadfb-0346-4870-b41e-a67327fa463f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:51.876886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:51.893254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07751-be6f-4336-8835-05693fcf4346 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:51.972285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fff69e-c6da-4e7a-ae97-73ab4031c9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:51.973092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fff69e-c6da-4e7a-ae97-73ab4031c9c1 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:51.973647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fff69e-c6da-4e7a-ae97-73ab4031c9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:51.973923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fff69e-c6da-4e7a-ae97-73ab4031c9c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.008283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fff69e-c6da-4e7a-ae97-73ab4031c9c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:52.009687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fff69e-c6da-4e7a-ae97-73ab4031c9c1 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-80fff69e-c6da-4e7a-ae97-73ab4031c9c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:52.050004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:52.050961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:52.052242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:52.052242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:52.052242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:52.052242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:52.052242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 356/704] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:52.058052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbadfb-0346-4870-b41e-a67327fa463f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:52.062074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fff69e-c6da-4e7a-ae97-73ab4031c9c1 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:52.130846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a03b28-9352-467c-8c43-b6f0afb1e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:52.131549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03b28-9352-467c-8c43-b6f0afb1e4aa None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.131828 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03b28-9352-467c-8c43-b6f0afb1e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.132098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a03b28-9352-467c-8c43-b6f0afb1e4aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.132938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a03b28-9352-467c-8c43-b6f0afb1e4aa None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=d8ea258578544e5c8f05b751d31e0f34) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:52.133246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a03b28-9352-467c-8c43-b6f0afb1e4aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:52.134678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a03b28-9352-467c-8c43-b6f0afb1e4aa None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:52.141328 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 349/705] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:51 2022] GET /identity/v3/role_assignments?user.id=d8ea258578544e5c8f05b751d31e0f34&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:52.146998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92dad3-1225-43b5-a977-dc87164ce28b None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.146998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92dad3-1225-43b5-a977-dc87164ce28b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.146998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92dad3-1225-43b5-a977-dc87164ce28b None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.146998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 350/706] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:52.151152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894666-722b-4f18-9488-663daf40f512 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.151439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894666-722b-4f18-9488-663daf40f512 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.151714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894666-722b-4f18-9488-663daf40f512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.166520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:52.173442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-55894666-722b-4f18-9488-663daf40f512 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:52.174426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-55894666-722b-4f18-9488-663daf40f512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:52.220308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fff69e-c6da-4e7a-ae97-73ab4031c9c1 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:52.334255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 351/707] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:52.338183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb5b4b-0d7d-4e04-b84e-b239eabc6902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:52.338860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb5b4b-0d7d-4e04-b84e-b239eabc6902 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.339169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb5b4b-0d7d-4e04-b84e-b239eabc6902 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.339444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb5b4b-0d7d-4e04-b84e-b239eabc6902 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.340233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb5b4b-0d7d-4e04-b84e-b239eabc6902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:52.341030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb5b4b-0d7d-4e04-b84e-b239eabc6902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:52.342425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb5b4b-0d7d-4e04-b84e-b239eabc6902 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:52.355543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 357/708] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:39:52.361238 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55894666-722b-4f18-9488-663daf40f512 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:52.373469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb5b4b-0d7d-4e04-b84e-b239eabc6902 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:52.377112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:52.498730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55894666-722b-4f18-9488-663daf40f512 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:52.505370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb5b4b-0d7d-4e04-b84e-b239eabc6902 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:52.544051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf059fb-1c05-47bc-a70f-9e0e37b633a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:52.544941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf059fb-1c05-47bc-a70f-9e0e37b633a7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.545193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf059fb-1c05-47bc-a70f-9e0e37b633a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.545407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf059fb-1c05-47bc-a70f-9e0e37b633a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.549445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:52.554479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf059fb-1c05-47bc-a70f-9e0e37b633a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:52.555682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa6441-abef-4fef-8ae9-8398a7380f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:52.555970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf059fb-1c05-47bc-a70f-9e0e37b633a7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:52.557158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa6441-abef-4fef-8ae9-8398a7380f4b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.557865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa6441-abef-4fef-8ae9-8398a7380f4b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.558676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa6441-abef-4fef-8ae9-8398a7380f4b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.560259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa6441-abef-4fef-8ae9-8398a7380f4b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:52.562009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa6441-abef-4fef-8ae9-8398a7380f4b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-5cf059fb-1c05-47bc-a70f-9e0e37b633a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:52.570806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:52.574164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 352/709] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468ed0d-bd3c-432b-92c8-d73e5350e97a None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.575524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468ed0d-bd3c-432b-92c8-d73e5350e97a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.576328 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468ed0d-bd3c-432b-92c8-d73e5350e97a None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.579291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 353/710] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-0caa6441-abef-4fef-8ae9-8398a7380f4b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:52.582072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:52.583319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 13:39:52.584158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:52.584999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb7ca-e9f4-48fc-bbc2-131564c299a2 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.584999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb7ca-e9f4-48fc-bbc2-131564c299a2 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.585144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb7ca-e9f4-48fc-bbc2-131564c299a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.587278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 358/711] 10.222.0.42 () {56 vars in 1129 bytes} [Fri May 27 13:39:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:52.588266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa6441-abef-4fef-8ae9-8398a7380f4b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:52.609835 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-20dbb7ca-e9f4-48fc-bbc2-131564c299a2 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:52.611039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-20dbb7ca-e9f4-48fc-bbc2-131564c299a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:52.681554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:52.700390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 354/712] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:52.701936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbb7ca-e9f4-48fc-bbc2-131564c299a2 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:52.741438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa6441-abef-4fef-8ae9-8398a7380f4b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:52.778601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ef3dd-2084-4560-b734-ba3da6d1b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:52.779684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ef3dd-2084-4560-b734-ba3da6d1b3d7 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.780171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ef3dd-2084-4560-b734-ba3da6d1b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.780741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ef3dd-2084-4560-b734-ba3da6d1b3d7 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.781819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ef3dd-2084-4560-b734-ba3da6d1b3d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:52.782334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ef3dd-2084-4560-b734-ba3da6d1b3d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:52.783990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558ef3dd-2084-4560-b734-ba3da6d1b3d7 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:52.798433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 359/713] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:52.804692 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ef3dd-2084-4560-b734-ba3da6d1b3d7 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:52.825882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbb7ca-e9f4-48fc-bbc2-131564c299a2 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:52.857232 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:52.866054 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156d15f-a57c-44cc-bf8e-28250cb2fc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:52.870100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d15f-a57c-44cc-bf8e-28250cb2fc15 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.870100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d15f-a57c-44cc-bf8e-28250cb2fc15 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.870100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156d15f-a57c-44cc-bf8e-28250cb2fc15 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.870100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156d15f-a57c-44cc-bf8e-28250cb2fc15 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:52.870100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156d15f-a57c-44cc-bf8e-28250cb2fc15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:52.870100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156d15f-a57c-44cc-bf8e-28250cb2fc15 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:52.880503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 355/714] 10.222.0.42 () {56 vars in 1124 bytes} [Fri May 27 13:39:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:52.880503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156d15f-a57c-44cc-bf8e-28250cb2fc15 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:52.921941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ef3dd-2084-4560-b734-ba3da6d1b3d7 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:52.950634 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:52.960097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9656776-a00a-44f0-a4b1-4a49d817afe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:52.961138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9656776-a00a-44f0-a4b1-4a49d817afe7 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:52.961642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9656776-a00a-44f0-a4b1-4a49d817afe7 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:52.962186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9656776-a00a-44f0-a4b1-4a49d817afe7 None admin] PATH_INFO: `/v3/services/network` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:52.963055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9656776-a00a-44f0-a4b1-4a49d817afe7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:52.964631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9656776-a00a-44f0-a4b1-4a49d817afe7 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-f9656776-a00a-44f0-a4b1-4a49d817afe7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:52.977383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:52.978354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 13:39:52.979205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:52.982666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 360/715] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:52 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:52.983719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9656776-a00a-44f0-a4b1-4a49d817afe7 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:52.998112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156d15f-a57c-44cc-bf8e-28250cb2fc15 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:53.042762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c1463-03ed-42ef-bcc4-dfc832b55924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:53.043479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c1463-03ed-42ef-bcc4-dfc832b55924 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:53.043761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c1463-03ed-42ef-bcc4-dfc832b55924 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:53.044039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c1463-03ed-42ef-bcc4-dfc832b55924 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:53.044878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c1463-03ed-42ef-bcc4-dfc832b55924 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=9a1644fa5cd3499d9d6ad057067255e9) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:53.045541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c1463-03ed-42ef-bcc4-dfc832b55924 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:53.047161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c1463-03ed-42ef-bcc4-dfc832b55924 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:53.059127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 356/716] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:52 2022] GET /identity/v3/role_assignments?user.id=9a1644fa5cd3499d9d6ad057067255e9&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=3951cc86a51d416fafc5676d456e79ce => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:53.059127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c1463-03ed-42ef-bcc4-dfc832b55924 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:53.118743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:53.173063 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9656776-a00a-44f0-a4b1-4a49d817afe7 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:53.178132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c1463-03ed-42ef-bcc4-dfc832b55924 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:53.226594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885ae4f-34a4-401a-9e84-def57c46fa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:53.227304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885ae4f-34a4-401a-9e84-def57c46fa8c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:53.227642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885ae4f-34a4-401a-9e84-def57c46fa8c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:53.227920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885ae4f-34a4-401a-9e84-def57c46fa8c None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:53.228846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885ae4f-34a4-401a-9e84-def57c46fa8c None admin] RBAC: Adding query filter params (name=network) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:53.229157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885ae4f-34a4-401a-9e84-def57c46fa8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:53.230642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a885ae4f-34a4-401a-9e84-def57c46fa8c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:53.241677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 357/717] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:39:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:53.243272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885ae4f-34a4-401a-9e84-def57c46fa8c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:53.296492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d25c4e-27c4-4a18-9a04-28495dbd11ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:53.297180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d25c4e-27c4-4a18-9a04-28495dbd11ba None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:53.297465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d25c4e-27c4-4a18-9a04-28495dbd11ba None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:53.297744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d25c4e-27c4-4a18-9a04-28495dbd11ba None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:53.298468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d25c4e-27c4-4a18-9a04-28495dbd11ba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:53.298778 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d25c4e-27c4-4a18-9a04-28495dbd11ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:53.300450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d25c4e-27c4-4a18-9a04-28495dbd11ba None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:53.314610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 361/718] 10.222.0.42 () {56 vars in 1124 bytes} [Fri May 27 13:39:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:53.362951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a885ae4f-34a4-401a-9e84-def57c46fa8c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:53.395506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:53.408682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1914f31-a5fb-461e-981b-2acbdb2011f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:53.409362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1914f31-a5fb-461e-981b-2acbdb2011f2 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:53.409645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1914f31-a5fb-461e-981b-2acbdb2011f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:53.409920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1914f31-a5fb-461e-981b-2acbdb2011f2 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:53.410641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1914f31-a5fb-461e-981b-2acbdb2011f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:53.410946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1914f31-a5fb-461e-981b-2acbdb2011f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:53.412640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1914f31-a5fb-461e-981b-2acbdb2011f2 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:53.427230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 358/719] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:39:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:54.620879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88246-9d93-4a1e-8a53-efc783874d59 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:54.621434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88246-9d93-4a1e-8a53-efc783874d59 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:54.621434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d88246-9d93-4a1e-8a53-efc783874d59 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:54.623112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 362/720] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:54.628558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b1607-71fb-4931-963d-f36ea4987bfe None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:54.628965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b1607-71fb-4931-963d-f36ea4987bfe None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:54.629131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b1607-71fb-4931-963d-f36ea4987bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:54.655977 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4b3b1607-71fb-4931-963d-f36ea4987bfe None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:54.657179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4b3b1607-71fb-4931-963d-f36ea4987bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:54.730450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38472a6-8c19-4a8d-a270-a2fc61655f3b None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:54.731402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38472a6-8c19-4a8d-a270-a2fc61655f3b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:54.731565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38472a6-8c19-4a8d-a270-a2fc61655f3b None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:54.733291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 363/721] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:54.739056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc6f2b-141c-4a55-a4ef-7697c91f476e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:54.739346 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc6f2b-141c-4a55-a4ef-7697c91f476e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:54.739624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc6f2b-141c-4a55-a4ef-7697c91f476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:54.760776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-24cc6f2b-141c-4a55-a4ef-7697c91f476e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:54.762025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-24cc6f2b-141c-4a55-a4ef-7697c91f476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:54.763092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 359/722] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:54.790058 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b1607-71fb-4931-963d-f36ea4987bfe None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:54.855363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:54.894037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 364/723] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 13:39:54.947166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc6f2b-141c-4a55-a4ef-7697c91f476e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:54.984318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b1607-71fb-4931-963d-f36ea4987bfe None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:55.015336 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:55.056708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557574d-339a-4bb4-91e7-08030c6999c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:55.057517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557574d-339a-4bb4-91e7-08030c6999c8 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:55.057799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557574d-339a-4bb4-91e7-08030c6999c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:55.058071 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557574d-339a-4bb4-91e7-08030c6999c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:55.079975 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557574d-339a-4bb4-91e7-08030c6999c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-c557574d-339a-4bb4-91e7-08030c6999c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:55.088182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:55.089112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:55.089939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 360/724] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:55.097214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557574d-339a-4bb4-91e7-08030c6999c8 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:55.161258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc6f2b-141c-4a55-a4ef-7697c91f476e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:55.238750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbb762-6d15-4f6b-be67-60048d3a2827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:55.239572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb762-6d15-4f6b-be67-60048d3a2827 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:55.239852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb762-6d15-4f6b-be67-60048d3a2827 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:55.240120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb762-6d15-4f6b-be67-60048d3a2827 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:55.252579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557574d-339a-4bb4-91e7-08030c6999c8 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:55.266389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbb762-6d15-4f6b-be67-60048d3a2827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-7bbbb762-6d15-4f6b-be67-60048d3a2827 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:55.273964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:55.274913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:55.275833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:55.285088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 365/725] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:39:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:55.295308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbb762-6d15-4f6b-be67-60048d3a2827 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:55.333067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673409d-d820-4f34-80f8-41ef8237b4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:55.333743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673409d-d820-4f34-80f8-41ef8237b4da None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:55.334029 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673409d-d820-4f34-80f8-41ef8237b4da None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:55.334303 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d673409d-d820-4f34-80f8-41ef8237b4da None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:55.335072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673409d-d820-4f34-80f8-41ef8237b4da None admin] RBAC: Adding query filter params (name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:55.335377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673409d-d820-4f34-80f8-41ef8237b4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:55.336758 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d673409d-d820-4f34-80f8-41ef8237b4da None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:55.346228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 361/726] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:39:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:55.353616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673409d-d820-4f34-80f8-41ef8237b4da None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:55.395372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:55.439533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbb762-6d15-4f6b-be67-60048d3a2827 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:55.465504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:55.476538 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7edf6f-fac9-4689-80f7-faee9bf69531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:55.477300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7edf6f-fac9-4689-80f7-faee9bf69531 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:55.477471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7edf6f-fac9-4689-80f7-faee9bf69531 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:55.477730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7edf6f-fac9-4689-80f7-faee9bf69531 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:55.478474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7edf6f-fac9-4689-80f7-faee9bf69531 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:55.478779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7edf6f-fac9-4689-80f7-faee9bf69531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:55.480232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7edf6f-fac9-4689-80f7-faee9bf69531 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:55.489848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 366/727] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:55.495214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7edf6f-fac9-4689-80f7-faee9bf69531 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:55.588678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d673409d-d820-4f34-80f8-41ef8237b4da None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:55.600973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7edf6f-fac9-4689-80f7-faee9bf69531 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:55.623544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:55.636341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb65ff4-3112-43b7-8a14-42d93d6d5256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:55.637477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb65ff4-3112-43b7-8a14-42d93d6d5256 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:55.637888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb65ff4-3112-43b7-8a14-42d93d6d5256 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:55.638402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb65ff4-3112-43b7-8a14-42d93d6d5256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:55.649737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb65ff4-3112-43b7-8a14-42d93d6d5256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:55.651572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb65ff4-3112-43b7-8a14-42d93d6d5256 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:55.656650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d2cd-46b3-4f29-b85f-67a83fbd2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:55.657468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d2cd-46b3-4f29-b85f-67a83fbd2296 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:55.657751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d2cd-46b3-4f29-b85f-67a83fbd2296 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:55.658026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d2cd-46b3-4f29-b85f-67a83fbd2296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ecb65ff4-3112-43b7-8a14-42d93d6d5256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:55.671998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:55.672935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:55.673818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:55.673818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:55.673818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:55.673818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:55.675977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 367/728] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:55.681803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb65ff4-3112-43b7-8a14-42d93d6d5256 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:55.683681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d2cd-46b3-4f29-b85f-67a83fbd2296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:55.685552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d2cd-46b3-4f29-b85f-67a83fbd2296 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-e1d9d2cd-46b3-4f29-b85f-67a83fbd2296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:55.727861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:55.728892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:55.729770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:55.729770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:55.729770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:55.729770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:55.729770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 362/729] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:55.735941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d2cd-46b3-4f29-b85f-67a83fbd2296 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:55.791670 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb65ff4-3112-43b7-8a14-42d93d6d5256 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:55.829668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25a13e-b96c-4f2b-9f62-d1177a4e8075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:55.830864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25a13e-b96c-4f2b-9f62-d1177a4e8075 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:55.831340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25a13e-b96c-4f2b-9f62-d1177a4e8075 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:55.831824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25a13e-b96c-4f2b-9f62-d1177a4e8075 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:55.832783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25a13e-b96c-4f2b-9f62-d1177a4e8075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:55.833325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25a13e-b96c-4f2b-9f62-d1177a4e8075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:55.835012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25a13e-b96c-4f2b-9f62-d1177a4e8075 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:55.849975 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 368/730] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:55.856598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25a13e-b96c-4f2b-9f62-d1177a4e8075 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:55.911402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:55.971097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25a13e-b96c-4f2b-9f62-d1177a4e8075 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:55.987431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:56.007834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545c549-64f4-46c4-a090-e2642c1356a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:56.008597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d2cd-46b3-4f29-b85f-67a83fbd2296 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:56.009214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545c549-64f4-46c4-a090-e2642c1356a3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.009730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545c549-64f4-46c4-a090-e2642c1356a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.010193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545c549-64f4-46c4-a090-e2642c1356a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.025669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545c549-64f4-46c4-a090-e2642c1356a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:56.030167 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545c549-64f4-46c4-a090-e2642c1356a3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-a545c549-64f4-46c4-a090-e2642c1356a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:56.060293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:56.061405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:56.062344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:56.062344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:56.062344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:56.062344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:56.062344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:56.062344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:56.062344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:56.062344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:56.062344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 13:39:56.062344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:56.066380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 369/731] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:39:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:56.071003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ea637-7371-4011-b3aa-7537f8f2c33c None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.071003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ea637-7371-4011-b3aa-7537f8f2c33c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.071003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ea637-7371-4011-b3aa-7537f8f2c33c None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.071003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 370/732] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:56.074279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ea637-7371-4011-b3aa-7537f8f2c33c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:56.080982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33981449-8b6f-47a5-bf13-b7eb1376ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:56.081968 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33981449-8b6f-47a5-bf13-b7eb1376ea65 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.082476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33981449-8b6f-47a5-bf13-b7eb1376ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.082762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33981449-8b6f-47a5-bf13-b7eb1376ea65 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.084026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33981449-8b6f-47a5-bf13-b7eb1376ea65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:56.084343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33981449-8b6f-47a5-bf13-b7eb1376ea65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:56.086130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33981449-8b6f-47a5-bf13-b7eb1376ea65 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:56.098865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 363/733] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:56.099988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350ffa6-4f19-4a3f-82ba-df6e601cb1da None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.100262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350ffa6-4f19-4a3f-82ba-df6e601cb1da None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.100540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350ffa6-4f19-4a3f-82ba-df6e601cb1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.118885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f350ffa6-4f19-4a3f-82ba-df6e601cb1da None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:56.120188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f350ffa6-4f19-4a3f-82ba-df6e601cb1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:56.160989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:56.183429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ea637-7371-4011-b3aa-7537f8f2c33c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:56.190355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 364/734] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:56.191708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d037650-1f4e-49b4-8057-5bff21bb22de None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.191996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d037650-1f4e-49b4-8057-5bff21bb22de None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.192272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d037650-1f4e-49b4-8057-5bff21bb22de None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.195120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 365/735] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:56.195120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d037650-1f4e-49b4-8057-5bff21bb22de None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:56.222274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18494a4-c3f9-446e-8228-a7112aeafc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:56.222948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18494a4-c3f9-446e-8228-a7112aeafc3e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.223266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18494a4-c3f9-446e-8228-a7112aeafc3e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.223545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18494a4-c3f9-446e-8228-a7112aeafc3e None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.224381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18494a4-c3f9-446e-8228-a7112aeafc3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:56.224694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18494a4-c3f9-446e-8228-a7112aeafc3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:56.226120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18494a4-c3f9-446e-8228-a7112aeafc3e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:56.244514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 371/736] 10.222.0.42 () {56 vars in 1135 bytes} [Fri May 27 13:39:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:56.245725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11ffa-daa5-4356-a64a-d9721e4c844b None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.246016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11ffa-daa5-4356-a64a-d9721e4c844b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.246322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11ffa-daa5-4356-a64a-d9721e4c844b None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.248653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 372/737] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:56.249843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1047e8a-4862-47aa-84fd-e0f6ba6be300 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.249957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1047e8a-4862-47aa-84fd-e0f6ba6be300 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.250191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1047e8a-4862-47aa-84fd-e0f6ba6be300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.265930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-e1047e8a-4862-47aa-84fd-e0f6ba6be300 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:56.267152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-e1047e8a-4862-47aa-84fd-e0f6ba6be300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:56.279176 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:56.302596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d037650-1f4e-49b4-8057-5bff21bb22de None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:56.332813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 373/738] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:56.333718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1047e8a-4862-47aa-84fd-e0f6ba6be300 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:56.352415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6075d2a-9415-484c-a884-9f4890ae3690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:56.353518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6075d2a-9415-484c-a884-9f4890ae3690 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.354015 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6075d2a-9415-484c-a884-9f4890ae3690 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.354289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6075d2a-9415-484c-a884-9f4890ae3690 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.362839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6075d2a-9415-484c-a884-9f4890ae3690 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:56.364329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6075d2a-9415-484c-a884-9f4890ae3690 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-b6075d2a-9415-484c-a884-9f4890ae3690 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:56.379712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:56.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:56.381595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 366/739] 10.222.0.42 () {56 vars in 1117 bytes} [Fri May 27 13:39:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:56.382172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6075d2a-9415-484c-a884-9f4890ae3690 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:56.404087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:56.438705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1047e8a-4862-47aa-84fd-e0f6ba6be300 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:56.472650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b925a63-c9ea-40bd-bc70-afb1d61b3a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:56.473433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925a63-c9ea-40bd-bc70-afb1d61b3a05 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.473725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925a63-c9ea-40bd-bc70-afb1d61b3a05 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.473996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925a63-c9ea-40bd-bc70-afb1d61b3a05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.483668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6075d2a-9415-484c-a884-9f4890ae3690 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:56.484886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b925a63-c9ea-40bd-bc70-afb1d61b3a05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-5b925a63-c9ea-40bd-bc70-afb1d61b3a05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:39:56.492394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:56.493353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 374/740] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:39:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:56.495192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf409b-5512-4e49-9d6c-57efe0cf8cd7 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.495946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf409b-5512-4e49-9d6c-57efe0cf8cd7 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.495946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf409b-5512-4e49-9d6c-57efe0cf8cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.514438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3fbf409b-5512-4e49-9d6c-57efe0cf8cd7 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:56.515648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3fbf409b-5512-4e49-9d6c-57efe0cf8cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:56.520416 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd167a-02a0-40be-a6f3-6a40b661de06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:56.521064 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd167a-02a0-40be-a6f3-6a40b661de06 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.521347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd167a-02a0-40be-a6f3-6a40b661de06 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.521623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd167a-02a0-40be-a6f3-6a40b661de06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.525070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:56.583090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 375/741] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 13:39:56.583910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf409b-5512-4e49-9d6c-57efe0cf8cd7 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:56.589130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd167a-02a0-40be-a6f3-6a40b661de06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:56.591343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd167a-02a0-40be-a6f3-6a40b661de06 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:56.650752 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:56.694336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf409b-5512-4e49-9d6c-57efe0cf8cd7 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:56.696342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 367/742] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 13:39:56.697179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd167a-02a0-40be-a6f3-6a40b661de06 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:56.731067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:56.733650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787b72a-9080-4954-98d7-ef19bf90d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:56.734314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787b72a-9080-4954-98d7-ef19bf90d664 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.734597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787b72a-9080-4954-98d7-ef19bf90d664 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.734871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787b72a-9080-4954-98d7-ef19bf90d664 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.735620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787b72a-9080-4954-98d7-ef19bf90d664 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:56.736994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787b72a-9080-4954-98d7-ef19bf90d664 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:56.794252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd167a-02a0-40be-a6f3-6a40b661de06 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:56.827247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc6eb5-e70f-4013-8c77-ef8a07ba574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:56.827912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc6eb5-e70f-4013-8c77-ef8a07ba574c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:56.828223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc6eb5-e70f-4013-8c77-ef8a07ba574c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:56.828501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc6eb5-e70f-4013-8c77-ef8a07ba574c None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:56.829365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc6eb5-e70f-4013-8c77-ef8a07ba574c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:56.829675 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc6eb5-e70f-4013-8c77-ef8a07ba574c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:56.831126 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc6eb5-e70f-4013-8c77-ef8a07ba574c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:56.845562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 376/743] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:39:56 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:39:56.846385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787b72a-9080-4954-98d7-ef19bf90d664 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:56.855361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 368/744] 10.222.0.42 () {56 vars in 1149 bytes} [Fri May 27 13:39:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:56.856858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc6eb5-e70f-4013-8c77-ef8a07ba574c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:56.974730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:56.982413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc6eb5-e70f-4013-8c77-ef8a07ba574c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:56.983349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787b72a-9080-4954-98d7-ef19bf90d664 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:56.998301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:57.022573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb229-9a8a-4b1d-9f53-bcef6ab2d1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:57.023379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb229-9a8a-4b1d-9f53-bcef6ab2d1d5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:57.023661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb229-9a8a-4b1d-9f53-bcef6ab2d1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:57.023933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb229-9a8a-4b1d-9f53-bcef6ab2d1d5 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:57.024746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb229-9a8a-4b1d-9f53-bcef6ab2d1d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:57.025114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb229-9a8a-4b1d-9f53-bcef6ab2d1d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:57.025764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dcf8b-1082-4ad3-aa4c-dd28efe3c68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:57.026429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dcf8b-1082-4ad3-aa4c-dd28efe3c68f None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:57.026559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb229-9a8a-4b1d-9f53-bcef6ab2d1d5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:57.026720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dcf8b-1082-4ad3-aa4c-dd28efe3c68f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:57.026998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dcf8b-1082-4ad3-aa4c-dd28efe3c68f None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:57.028458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dcf8b-1082-4ad3-aa4c-dd28efe3c68f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:57.029814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dcf8b-1082-4ad3-aa4c-dd28efe3c68f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:57.036590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 377/745] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:39:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:57.037490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb229-9a8a-4b1d-9f53-bcef6ab2d1d5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:57.098575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 369/746] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:39:56 2022] POST /identity/v3/services => generated 240 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:39:57.099394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dcf8b-1082-4ad3-aa4c-dd28efe3c68f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:57.150251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb229-9a8a-4b1d-9f53-bcef6ab2d1d5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:57.208901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22f3fb-9bad-482c-ab65-341e4f45d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:57.210224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22f3fb-9bad-482c-ab65-341e4f45d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:57.210595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22f3fb-9bad-482c-ab65-341e4f45d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:57.210874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22f3fb-9bad-482c-ab65-341e4f45d3f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:57.226910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dcf8b-1082-4ad3-aa4c-dd28efe3c68f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:57.227362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22f3fb-9bad-482c-ab65-341e4f45d3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:57.228796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22f3fb-9bad-482c-ab65-341e4f45d3f6 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ec22f3fb-9bad-482c-ab65-341e4f45d3f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:57.255629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:57.256583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:57.257454 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:57.257454 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:57.257454 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:57.257454 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:57.259131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 378/747] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:57.260408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22f3fb-9bad-482c-ab65-341e4f45d3f6 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:57.278547 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa7356-ca8e-4904-8d1d-8e0e57069523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:57.279625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa7356-ca8e-4904-8d1d-8e0e57069523 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:57.280117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa7356-ca8e-4904-8d1d-8e0e57069523 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:57.280590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa7356-ca8e-4904-8d1d-8e0e57069523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:57.297003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:57.310301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:57.365825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa7356-ca8e-4904-8d1d-8e0e57069523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:57.367505 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa7356-ca8e-4904-8d1d-8e0e57069523 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:57.391599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22f3fb-9bad-482c-ab65-341e4f45d3f6 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:57.436559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd4ee-63ad-41c3-9c88-a80660f4cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:57.437699 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd4ee-63ad-41c3-9c88-a80660f4cac1 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:57.438169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd4ee-63ad-41c3-9c88-a80660f4cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:57.438624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbd4ee-63ad-41c3-9c88-a80660f4cac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:57.451361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbd4ee-63ad-41c3-9c88-a80660f4cac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:57.453077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbd4ee-63ad-41c3-9c88-a80660f4cac1 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-6dcbd4ee-63ad-41c3-9c88-a80660f4cac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:57.473700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:57.474624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:57.475548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:57.475548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:57.475548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:57.475548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:57.478085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 379/748] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:57.479167 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd4ee-63ad-41c3-9c88-a80660f4cac1 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:57.488648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 370/749] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:39:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:39:57.493597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa7356-ca8e-4904-8d1d-8e0e57069523 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:57.551391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:57.571348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:57.600004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa7356-ca8e-4904-8d1d-8e0e57069523 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:57.601117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbd4ee-63ad-41c3-9c88-a80660f4cac1 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:57.639575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52de3e-80c4-4ba2-a8ce-f6aa31b909b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:57.640193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52de3e-80c4-4ba2-a8ce-f6aa31b909b8 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:57.640478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52de3e-80c4-4ba2-a8ce-f6aa31b909b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:57.640755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52de3e-80c4-4ba2-a8ce-f6aa31b909b8 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:57.641489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52de3e-80c4-4ba2-a8ce-f6aa31b909b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:57.641898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52de3e-80c4-4ba2-a8ce-f6aa31b909b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:57.643594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52de3e-80c4-4ba2-a8ce-f6aa31b909b8 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:57.643792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c36fb-b5e5-42b8-aa30-c1df25d36643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:57.644662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c36fb-b5e5-42b8-aa30-c1df25d36643 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:57.645228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c36fb-b5e5-42b8-aa30-c1df25d36643 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:57.649077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c36fb-b5e5-42b8-aa30-c1df25d36643 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:57.650092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c36fb-b5e5-42b8-aa30-c1df25d36643 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:57.650612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c36fb-b5e5-42b8-aa30-c1df25d36643 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:57.652230 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c36fb-b5e5-42b8-aa30-c1df25d36643 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:57.656466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 371/750] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:57.657384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52de3e-80c4-4ba2-a8ce-f6aa31b909b8 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:57.666625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 380/751] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:57.667790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c36fb-b5e5-42b8-aa30-c1df25d36643 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:57.791465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c36fb-b5e5-42b8-aa30-c1df25d36643 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:57.805302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52de3e-80c4-4ba2-a8ce-f6aa31b909b8 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:57.820287 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:57.837598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4af921-de76-4358-9358-90c446c32a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:57.838587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4af921-de76-4358-9358-90c446c32a87 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:57.839071 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4af921-de76-4358-9358-90c446c32a87 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:57.839492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4af921-de76-4358-9358-90c446c32a87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:57.841951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d76c-1a05-41b3-98bb-9de457ef68ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:57.842430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:57.844052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d76c-1a05-41b3-98bb-9de457ef68ee None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:57.844336 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d76c-1a05-41b3-98bb-9de457ef68ee None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:57.844678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d76c-1a05-41b3-98bb-9de457ef68ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:57.850089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4af921-de76-4358-9358-90c446c32a87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:57.851787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4af921-de76-4358-9358-90c446c32a87 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:57.859186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d76c-1a05-41b3-98bb-9de457ef68ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:57.860788 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d76c-1a05-41b3-98bb-9de457ef68ee None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-1f4af921-de76-4358-9358-90c446c32a87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:39:57.870716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:57.872432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:57.873608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:57.873608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:57.873608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:39:57.873608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:39:57.873608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:39:57.873608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:39:57.873608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:39:57.873608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:39:57.873608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 13:39:57.873608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:57.880375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 381/752] 10.222.0.42 () {56 vars in 1093 bytes} [Fri May 27 13:39:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:57.881369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4af921-de76-4358-9358-90c446c32a87 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-1c66d76c-1a05-41b3-98bb-9de457ef68ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:57.882346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:57.883444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:57.884570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:57.884570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:57.884570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:57.884570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:57.885641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 372/753] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:57.886611 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d76c-1a05-41b3-98bb-9de457ef68ee None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:58.003340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4af921-de76-4358-9358-90c446c32a87 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:58.024804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d76c-1a05-41b3-98bb-9de457ef68ee None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:58.045075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245e83-e50c-4abc-92d8-098e2e95c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:58.046130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245e83-e50c-4abc-92d8-098e2e95c98d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:58.046432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245e83-e50c-4abc-92d8-098e2e95c98d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:58.046873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a245e83-e50c-4abc-92d8-098e2e95c98d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:58.055731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245e83-e50c-4abc-92d8-098e2e95c98d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:58.057271 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a245e83-e50c-4abc-92d8-098e2e95c98d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:58.069557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f9c0d-3e6d-4b3a-b992-ae476363bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:58.070445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f9c0d-3e6d-4b3a-b992-ae476363bab6 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:58.070874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f9c0d-3e6d-4b3a-b992-ae476363bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:58.071323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f9c0d-3e6d-4b3a-b992-ae476363bab6 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:58.072324 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f9c0d-3e6d-4b3a-b992-ae476363bab6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:58.072778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f9c0d-3e6d-4b3a-b992-ae476363bab6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-6a245e83-e50c-4abc-92d8-098e2e95c98d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:58.073424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:58.074446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:58.075966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:58.075966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:58.075966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:58.075966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:58.075966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:58.075966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:58.075966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:58.075966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:58.081645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 382/754] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:58.081645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245e83-e50c-4abc-92d8-098e2e95c98d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:58.082639 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f9c0d-3e6d-4b3a-b992-ae476363bab6 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:58.111702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 373/755] 10.222.0.42 () {56 vars in 1133 bytes} [Fri May 27 13:39:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:58.112499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f9c0d-3e6d-4b3a-b992-ae476363bab6 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:58.144508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:58.157739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:58.217947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a245e83-e50c-4abc-92d8-098e2e95c98d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:58.223935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f9c0d-3e6d-4b3a-b992-ae476363bab6 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:58.261866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd242f2-22db-4cf8-90e5-442e4e213338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:58.262604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd242f2-22db-4cf8-90e5-442e4e213338 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:58.262949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd242f2-22db-4cf8-90e5-442e4e213338 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:58.263330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd242f2-22db-4cf8-90e5-442e4e213338 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:58.264187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd242f2-22db-4cf8-90e5-442e4e213338 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:58.264555 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd242f2-22db-4cf8-90e5-442e4e213338 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:58.265466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe2679-870a-4b6f-8ef9-c7d232d0b6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:58.266286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd242f2-22db-4cf8-90e5-442e4e213338 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:58.266506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe2679-870a-4b6f-8ef9-c7d232d0b6c5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:58.266953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe2679-870a-4b6f-8ef9-c7d232d0b6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:58.267445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe2679-870a-4b6f-8ef9-c7d232d0b6c5 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:58.268628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe2679-870a-4b6f-8ef9-c7d232d0b6c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:58.269116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe2679-870a-4b6f-8ef9-c7d232d0b6c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:58.271163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe2679-870a-4b6f-8ef9-c7d232d0b6c5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:58.284743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 374/756] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:58.285438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 383/757] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:58.285826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd242f2-22db-4cf8-90e5-442e4e213338 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:58.287491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe2679-870a-4b6f-8ef9-c7d232d0b6c5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:58.405998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe2679-870a-4b6f-8ef9-c7d232d0b6c5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:58.409718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:58.422051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:58.432835 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd242f2-22db-4cf8-90e5-442e4e213338 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:58.444383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10e903-d5b8-4a31-9d4a-ee12f1c27626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:58.445036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10e903-d5b8-4a31-9d4a-ee12f1c27626 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:58.445375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10e903-d5b8-4a31-9d4a-ee12f1c27626 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:58.445706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10e903-d5b8-4a31-9d4a-ee12f1c27626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:58.450191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10e903-d5b8-4a31-9d4a-ee12f1c27626 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=d8ea258578544e5c8f05b751d31e0f34) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:58.450191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10e903-d5b8-4a31-9d4a-ee12f1c27626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:58.450191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10e903-d5b8-4a31-9d4a-ee12f1c27626 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:58.463182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 384/758] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:58 2022] GET /identity/v3/role_assignments?user.id=d8ea258578544e5c8f05b751d31e0f34&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=3951cc86a51d416fafc5676d456e79ce => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:58.464378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10e903-d5b8-4a31-9d4a-ee12f1c27626 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:58.479625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b8ebc-1bd6-4fb3-9241-07f460e6cd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:58.480698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b8ebc-1bd6-4fb3-9241-07f460e6cd22 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:58.481347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b8ebc-1bd6-4fb3-9241-07f460e6cd22 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:58.481760 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b8ebc-1bd6-4fb3-9241-07f460e6cd22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:58.496320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b8ebc-1bd6-4fb3-9241-07f460e6cd22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:58.498449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b8ebc-1bd6-4fb3-9241-07f460e6cd22 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-a09b8ebc-1bd6-4fb3-9241-07f460e6cd22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:39:58.520655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:58.521786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:58.522707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:39:58.522707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:39:58.522707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:39:58.522707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:58.525318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 375/759] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:58.531672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b8ebc-1bd6-4fb3-9241-07f460e6cd22 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:58.659560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b8ebc-1bd6-4fb3-9241-07f460e6cd22 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:58.705189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ac406-46bc-44f6-9b32-4e2464a5636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:58.706261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ac406-46bc-44f6-9b32-4e2464a5636f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:58.706725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ac406-46bc-44f6-9b32-4e2464a5636f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:58.707180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ac406-46bc-44f6-9b32-4e2464a5636f None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:58.708073 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ac406-46bc-44f6-9b32-4e2464a5636f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:58.708539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ac406-46bc-44f6-9b32-4e2464a5636f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:58.710092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ac406-46bc-44f6-9b32-4e2464a5636f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:58.713863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:58.726601 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 376/760] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:58.732546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ac406-46bc-44f6-9b32-4e2464a5636f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:58.741381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10e903-d5b8-4a31-9d4a-ee12f1c27626 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:58.814445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdfc6f-6039-4cd3-8165-c730fe9ac7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:58.815192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdfc6f-6039-4cd3-8165-c730fe9ac7ed None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:58.815476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdfc6f-6039-4cd3-8165-c730fe9ac7ed None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:58.815751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdfc6f-6039-4cd3-8165-c730fe9ac7ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:58.827849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdfc6f-6039-4cd3-8165-c730fe9ac7ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:58.828915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdfc6f-6039-4cd3-8165-c730fe9ac7ed None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-44bdfc6f-6039-4cd3-8165-c730fe9ac7ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:58.853437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:58.854413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:58.855323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:58.855323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:58.855323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:58.855323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:58.855323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:58.855323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:58.855323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:58.855323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:58.855323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 385/761] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:39:58.865942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdfc6f-6039-4cd3-8165-c730fe9ac7ed None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:58.907273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ac406-46bc-44f6-9b32-4e2464a5636f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:58.940992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:58.991825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c61b2-d73a-47a4-8429-0cbb3819fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:58.992672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c61b2-d73a-47a4-8429-0cbb3819fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:58.992956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c61b2-d73a-47a4-8429-0cbb3819fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:58.993232 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c61b2-d73a-47a4-8429-0cbb3819fbd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.009924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c61b2-d73a-47a4-8429-0cbb3819fbd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:59.011485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c61b2-d73a-47a4-8429-0cbb3819fbd7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-3f5c61b2-d73a-47a4-8429-0cbb3819fbd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:39:59.034776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:59.035782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:59.036663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:39:59.036663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:39:59.036663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:39:59.036663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:39:59.036663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:39:59.036663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:39:59.036663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:39:59.036663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:39:59.036663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 377/762] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:59.046499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdfc6f-6039-4cd3-8165-c730fe9ac7ed None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:59.048531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c61b2-d73a-47a4-8429-0cbb3819fbd7 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:59.113915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cd70c-9179-418a-ad26-a510e1905571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:59.114509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cd70c-9179-418a-ad26-a510e1905571 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:59.114791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cd70c-9179-418a-ad26-a510e1905571 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:59.115090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cd70c-9179-418a-ad26-a510e1905571 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.116794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cd70c-9179-418a-ad26-a510e1905571 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:59.117109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cd70c-9179-418a-ad26-a510e1905571 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:59.118541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cd70c-9179-418a-ad26-a510e1905571 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:59.148689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 386/763] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:59.151193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cd70c-9179-418a-ad26-a510e1905571 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:59.158572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:59.222827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c61b2-d73a-47a4-8429-0cbb3819fbd7 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:59.271033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4701c533-f565-4220-9118-6291008b15dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:59.272225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701c533-f565-4220-9118-6291008b15dd None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:59.272514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701c533-f565-4220-9118-6291008b15dd None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:59.273072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4701c533-f565-4220-9118-6291008b15dd None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.273877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701c533-f565-4220-9118-6291008b15dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:59.274439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701c533-f565-4220-9118-6291008b15dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:59.276311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4701c533-f565-4220-9118-6291008b15dd None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:59.287389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:59.291541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cd70c-9179-418a-ad26-a510e1905571 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:59.294458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 378/764] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:59.296425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eaa1e-8c2b-4988-9025-e7e2063558fa None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:59.296717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eaa1e-8c2b-4988-9025-e7e2063558fa None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:59.296995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eaa1e-8c2b-4988-9025-e7e2063558fa None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.302847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 379/765] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:59.303861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eaa1e-8c2b-4988-9025-e7e2063558fa None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:59.336407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03efd9f-d0ed-4a02-8b04-3eaa4e20aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:59.337579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03efd9f-d0ed-4a02-8b04-3eaa4e20aa0b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:59.338208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03efd9f-d0ed-4a02-8b04-3eaa4e20aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:59.338582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03efd9f-d0ed-4a02-8b04-3eaa4e20aa0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.339560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03efd9f-d0ed-4a02-8b04-3eaa4e20aa0b None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=604a6139cec24af6a40c5eee3f197b7b) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:59.339970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03efd9f-d0ed-4a02-8b04-3eaa4e20aa0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:59.342307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03efd9f-d0ed-4a02-8b04-3eaa4e20aa0b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:59.355002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 387/766] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:39:59 2022] GET /identity/v3/role_assignments?user.id=604a6139cec24af6a40c5eee3f197b7b&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:59.355002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159612cb-cbff-40b3-8b7d-4efb73c28911 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:59.355002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159612cb-cbff-40b3-8b7d-4efb73c28911 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:59.355002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159612cb-cbff-40b3-8b7d-4efb73c28911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.382789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-159612cb-cbff-40b3-8b7d-4efb73c28911 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:59.386820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-159612cb-cbff-40b3-8b7d-4efb73c28911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:59.513564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eaa1e-8c2b-4988-9025-e7e2063558fa None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:59.551066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 388/767] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:39:59.551420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:59.572191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde9ae5-55e4-4e7b-a011-4e06aed753a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:59.573132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde9ae5-55e4-4e7b-a011-4e06aed753a6 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:59.573414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde9ae5-55e4-4e7b-a011-4e06aed753a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:59.573689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde9ae5-55e4-4e7b-a011-4e06aed753a6 None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/9a1644fa5cd3499d9d6ad057067255e9/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.576519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde9ae5-55e4-4e7b-a011-4e06aed753a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=9a1644fa5cd3499d9d6ad057067255e9, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:59.578074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde9ae5-55e4-4e7b-a011-4e06aed753a6 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:59.585275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159612cb-cbff-40b3-8b7d-4efb73c28911 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:59.690155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:39:59.698573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159612cb-cbff-40b3-8b7d-4efb73c28911 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:59.732061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac544e-a268-4c3c-9647-f7dcff0b0f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:59.732870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac544e-a268-4c3c-9647-f7dcff0b0f3c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:59.733152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac544e-a268-4c3c-9647-f7dcff0b0f3c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:59.733424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac544e-a268-4c3c-9647-f7dcff0b0f3c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.734076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac544e-a268-4c3c-9647-f7dcff0b0f3c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:59.735473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac544e-a268-4c3c-9647-f7dcff0b0f3c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-bcac544e-a268-4c3c-9647-f7dcff0b0f3c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:39:59.747948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:39:59.749396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:39:59.750316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 389/768] 10.222.0.42 () {56 vars in 1129 bytes} [Fri May 27 13:39:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:39:59.752931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4f76-a74e-40be-971f-68441b0ced6f None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:59.752931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4f76-a74e-40be-971f-68441b0ced6f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:59.752931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4f76-a74e-40be-971f-68441b0ced6f None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.754887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 390/769] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:39:59.756005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed4f76-a74e-40be-971f-68441b0ced6f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:59.863547 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 380/770] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:39:59 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/9a1644fa5cd3499d9d6ad057067255e9/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:39:59.865893 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ab55d-5b05-457a-94da-7f046cf0809a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:59.866553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ab55d-5b05-457a-94da-7f046cf0809a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:59.867384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ab55d-5b05-457a-94da-7f046cf0809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.881051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed4f76-a74e-40be-971f-68441b0ced6f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:39:59.910824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3d8ab55d-5b05-457a-94da-7f046cf0809a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:39:59.910824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3d8ab55d-5b05-457a-94da-7f046cf0809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:39:59.953888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699391-916c-4d4f-8dff-6a3059bb00cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:39:59.955820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699391-916c-4d4f-8dff-6a3059bb00cb None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:39:59.956107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699391-916c-4d4f-8dff-6a3059bb00cb None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:39:59.956383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf699391-916c-4d4f-8dff-6a3059bb00cb None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:39:59.957109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf699391-916c-4d4f-8dff-6a3059bb00cb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:39:59.957419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf699391-916c-4d4f-8dff-6a3059bb00cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:39:59.958837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf699391-916c-4d4f-8dff-6a3059bb00cb None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:39:59.969492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 391/771] 10.222.0.42 () {56 vars in 1124 bytes} [Fri May 27 13:39:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:39:59.970546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699391-916c-4d4f-8dff-6a3059bb00cb None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:39:59.998315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:00.071277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 381/772] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:39:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:00.100196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ab55d-5b05-457a-94da-7f046cf0809a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:00.112813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf699391-916c-4d4f-8dff-6a3059bb00cb None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:00.160934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0964b-b270-4a79-9400-99855c917c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:00.161608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0964b-b270-4a79-9400-99855c917c2b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:00.161893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0964b-b270-4a79-9400-99855c917c2b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:00.162168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0964b-b270-4a79-9400-99855c917c2b None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:00.162994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0964b-b270-4a79-9400-99855c917c2b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:00.163324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0964b-b270-4a79-9400-99855c917c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:00.164782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0964b-b270-4a79-9400-99855c917c2b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:00.176269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 392/773] 10.222.0.42 () {56 vars in 1124 bytes} [Fri May 27 13:39:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:00.181874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0964b-b270-4a79-9400-99855c917c2b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:00.224868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ab55d-5b05-457a-94da-7f046cf0809a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:00.235668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:00.264219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b38cbe-9042-4a38-8110-5b910d82d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:00.265499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b38cbe-9042-4a38-8110-5b910d82d968 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:00.266011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b38cbe-9042-4a38-8110-5b910d82d968 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:00.266590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b38cbe-9042-4a38-8110-5b910d82d968 None admin] PATH_INFO: `/v3/services/network` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:00.267813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b38cbe-9042-4a38-8110-5b910d82d968 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:00.269423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b38cbe-9042-4a38-8110-5b910d82d968 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-e7b38cbe-9042-4a38-8110-5b910d82d968 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:00.303541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:00.304634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:00.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 382/774] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:00 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:00.314405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b38cbe-9042-4a38-8110-5b910d82d968 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:00.327450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:00.364379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0964b-b270-4a79-9400-99855c917c2b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:00.421881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bfe99-abf1-40fc-8940-b8915a16ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:00.423630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bfe99-abf1-40fc-8940-b8915a16ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:00.423925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bfe99-abf1-40fc-8940-b8915a16ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:00.424463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bfe99-abf1-40fc-8940-b8915a16ccb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:00.425274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bfe99-abf1-40fc-8940-b8915a16ccb3 None admin] RBAC: Adding query filter params (interface=public, service_id=9ebd6aa9c561454fb280a037f41bf9e7, region_id=RegionOne) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:00.425587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bfe99-abf1-40fc-8940-b8915a16ccb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:00.426993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bfe99-abf1-40fc-8940-b8915a16ccb3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:00.455221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 393/775] 10.222.0.42 () {56 vars in 1251 bytes} [Fri May 27 13:40:00 2022] GET /identity/v3/endpoints?service_id=9ebd6aa9c561454fb280a037f41bf9e7&interface=public®ion_id=RegionOne => generated 194 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:00.456419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bfe99-abf1-40fc-8940-b8915a16ccb3 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:00.494470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b38cbe-9042-4a38-8110-5b910d82d968 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:00.541972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dfb77-aa17-4643-91bc-5b0c213f4650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:00.542646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dfb77-aa17-4643-91bc-5b0c213f4650 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:00.542925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dfb77-aa17-4643-91bc-5b0c213f4650 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:00.543263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dfb77-aa17-4643-91bc-5b0c213f4650 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:00.544041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dfb77-aa17-4643-91bc-5b0c213f4650 None admin] RBAC: Adding query filter params (name=network) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:00.544346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dfb77-aa17-4643-91bc-5b0c213f4650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:00.545733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03dfb77-aa17-4643-91bc-5b0c213f4650 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:00.552579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 383/776] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:00.557770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dfb77-aa17-4643-91bc-5b0c213f4650 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:00.623330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:00.708451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bfe99-abf1-40fc-8940-b8915a16ccb3 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:00.769278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dfb77-aa17-4643-91bc-5b0c213f4650 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:00.804343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341b4f-c34f-4d98-99ca-a5f9f685f553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:00.805041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341b4f-c34f-4d98-99ca-a5f9f685f553 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:00.805291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341b4f-c34f-4d98-99ca-a5f9f685f553 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:00.805567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341b4f-c34f-4d98-99ca-a5f9f685f553 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:00.811023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6341b4f-c34f-4d98-99ca-a5f9f685f553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:00.811023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6341b4f-c34f-4d98-99ca-a5f9f685f553 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:00.816842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628fd87-f871-4251-bd07-1e42a8a28792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:00.817739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628fd87-f871-4251-bd07-1e42a8a28792 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:00.817907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 394/777] 10.222.0.42 () {56 vars in 1087 bytes} [Fri May 27 13:40:00 2022] GET /identity/v3/services => generated 772 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:00.818353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628fd87-f871-4251-bd07-1e42a8a28792 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:00.818790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628fd87-f871-4251-bd07-1e42a8a28792 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:00.819723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628fd87-f871-4251-bd07-1e42a8a28792 None admin] RBAC: Adding query filter params (type=network) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:00.820202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628fd87-f871-4251-bd07-1e42a8a28792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:00.821795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628fd87-f871-4251-bd07-1e42a8a28792 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:00.836320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 384/778] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:00.842206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341b4f-c34f-4d98-99ca-a5f9f685f553 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:00.867356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:00.992774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341b4f-c34f-4d98-99ca-a5f9f685f553 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:01.043812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412a666-5f7f-4331-a3d1-f05b90d082a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:01.044371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a666-5f7f-4331-a3d1-f05b90d082a5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:01.044654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a666-5f7f-4331-a3d1-f05b90d082a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:01.044932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a666-5f7f-4331-a3d1-f05b90d082a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:01.045722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412a666-5f7f-4331-a3d1-f05b90d082a5 None admin] RBAC: Adding query filter params (interface=public, service_id=b19ef56b8ee0470c901f6399e850f373, region_id=RegionOne) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:01.046036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412a666-5f7f-4331-a3d1-f05b90d082a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:01.047455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412a666-5f7f-4331-a3d1-f05b90d082a5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:01.055357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 395/779] 10.222.0.42 () {56 vars in 1251 bytes} [Fri May 27 13:40:00 2022] GET /identity/v3/endpoints?service_id=b19ef56b8ee0470c901f6399e850f373&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:01.062050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628fd87-f871-4251-bd07-1e42a8a28792 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:01.120081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b81cd-f197-4a78-b1a3-b5fd9730fd18 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:01.120749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b81cd-f197-4a78-b1a3-b5fd9730fd18 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:01.121232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b81cd-f197-4a78-b1a3-b5fd9730fd18 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:01.124729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 396/780] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:01.130218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e14f7-330b-4ba5-b591-9d4b943a19f6 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:01.130562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e14f7-330b-4ba5-b591-9d4b943a19f6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:01.130767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e14f7-330b-4ba5-b591-9d4b943a19f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:01.156701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0d8e14f7-330b-4ba5-b591-9d4b943a19f6 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:01.158714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0d8e14f7-330b-4ba5-b591-9d4b943a19f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:01.197844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:01.203359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628fd87-f871-4251-bd07-1e42a8a28792 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:01.249365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5481-b09e-49fd-a165-6928b167e315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:01.250053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5481-b09e-49fd-a165-6928b167e315 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:01.250343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5481-b09e-49fd-a165-6928b167e315 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:01.250628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef5481-b09e-49fd-a165-6928b167e315 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:01.251358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef5481-b09e-49fd-a165-6928b167e315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:01.253052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef5481-b09e-49fd-a165-6928b167e315 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:01.263573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 397/781] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:01.263920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 385/782] 10.222.0.42 () {56 vars in 1087 bytes} [Fri May 27 13:40:01 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:01.287588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e14f7-330b-4ba5-b591-9d4b943a19f6 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:01.297488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:01.420393 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e14f7-330b-4ba5-b591-9d4b943a19f6 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:01.470437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c874c7-563e-4f3f-96d4-f1536055d09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:01.471301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c874c7-563e-4f3f-96d4-f1536055d09c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:01.471595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c874c7-563e-4f3f-96d4-f1536055d09c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:01.471868 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c874c7-563e-4f3f-96d4-f1536055d09c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:01.491416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c874c7-563e-4f3f-96d4-f1536055d09c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-09c874c7-563e-4f3f-96d4-f1536055d09c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:01.499307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:01.500243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:01.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 398/783] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:40:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:01.506783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5481-b09e-49fd-a165-6928b167e315 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:01.686372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef5481-b09e-49fd-a165-6928b167e315 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:01.736757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d402b-6cc6-4f23-b20f-15a482b1b613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:01.737459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d402b-6cc6-4f23-b20f-15a482b1b613 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:01.737777 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d402b-6cc6-4f23-b20f-15a482b1b613 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:01.738027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d402b-6cc6-4f23-b20f-15a482b1b613 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:01.738798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d402b-6cc6-4f23-b20f-15a482b1b613 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:01.739138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d402b-6cc6-4f23-b20f-15a482b1b613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:01.740542 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d402b-6cc6-4f23-b20f-15a482b1b613 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:01.753886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 386/784] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:40:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:01.759418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c874c7-563e-4f3f-96d4-f1536055d09c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:01.853315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:01.906788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c874c7-563e-4f3f-96d4-f1536055d09c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:01.954704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d3f54-7f0e-4025-b945-c105308a9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:01.955895 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d3f54-7f0e-4025-b945-c105308a9c9d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:01.956401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d3f54-7f0e-4025-b945-c105308a9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:01.956874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d3f54-7f0e-4025-b945-c105308a9c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:01.969985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d3f54-7f0e-4025-b945-c105308a9c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:01.971805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d3f54-7f0e-4025-b945-c105308a9c9d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-714d3f54-7f0e-4025-b945-c105308a9c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:01.989899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:01.990840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:01.991772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:01.991772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:01.991772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:01.991772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:01.994036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 399/785] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:01.999648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d402b-6cc6-4f23-b20f-15a482b1b613 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:02.022344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e71f7-6953-47fa-82ce-23641f07acd9 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.022999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e71f7-6953-47fa-82ce-23641f07acd9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.023475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e71f7-6953-47fa-82ce-23641f07acd9 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.025295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 400/786] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:02.033558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08cf53-c54a-4294-ac1d-2127fe854d59 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.034135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08cf53-c54a-4294-ac1d-2127fe854d59 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.034630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08cf53-c54a-4294-ac1d-2127fe854d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.050714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:02.053126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-5f08cf53-c54a-4294-ac1d-2127fe854d59 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:02.054559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5f08cf53-c54a-4294-ac1d-2127fe854d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:02.172073 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d402b-6cc6-4f23-b20f-15a482b1b613 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:02.180683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 401/787] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:02.210292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2b5a4-680c-4e2e-92ff-361c91edcf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:02.211588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08cf53-c54a-4294-ac1d-2127fe854d59 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:02.215259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2b5a4-680c-4e2e-92ff-361c91edcf8e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.215562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2b5a4-680c-4e2e-92ff-361c91edcf8e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.219271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2b5a4-680c-4e2e-92ff-361c91edcf8e None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.220323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2b5a4-680c-4e2e-92ff-361c91edcf8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:02.220842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2b5a4-680c-4e2e-92ff-361c91edcf8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:02.222415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2b5a4-680c-4e2e-92ff-361c91edcf8e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:02.246684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 387/788] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:02.256068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2b5a4-680c-4e2e-92ff-361c91edcf8e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:02.275340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:02.361772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08cf53-c54a-4294-ac1d-2127fe854d59 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:02.389441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:02.397327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97f17f-3dd0-4446-abb6-b11290f49042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:02.398405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f17f-3dd0-4446-abb6-b11290f49042 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.398849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f17f-3dd0-4446-abb6-b11290f49042 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.399318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97f17f-3dd0-4446-abb6-b11290f49042 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.407053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2b5a4-680c-4e2e-92ff-361c91edcf8e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:02.411556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97f17f-3dd0-4446-abb6-b11290f49042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-eb97f17f-3dd0-4446-abb6-b11290f49042 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:02.420028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:02.421171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:40:02.421995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:02.424934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 402/789] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:40:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:02.430797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97f17f-3dd0-4446-abb6-b11290f49042 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:02.463001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17719c-ab51-4dac-804c-2d0ecc8611ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:02.463592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17719c-ab51-4dac-804c-2d0ecc8611ab None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.463874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17719c-ab51-4dac-804c-2d0ecc8611ab None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.464148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17719c-ab51-4dac-804c-2d0ecc8611ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.472540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17719c-ab51-4dac-804c-2d0ecc8611ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:02.473998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17719c-ab51-4dac-804c-2d0ecc8611ab None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-5e17719c-ab51-4dac-804c-2d0ecc8611ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:02.489453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:02.490462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:02.491517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 388/790] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:40:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:02.492631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6f4aa-4ac9-4341-aca3-a95d266d7d4c None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.492737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6f4aa-4ac9-4341-aca3-a95d266d7d4c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.492928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6f4aa-4ac9-4341-aca3-a95d266d7d4c None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.499314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 389/791] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:02.500005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6f4aa-4ac9-4341-aca3-a95d266d7d4c None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:02.552883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97f17f-3dd0-4446-abb6-b11290f49042 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:02.563184 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:02.589478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb5bbb-bf24-442b-b2ff-1a910362a5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:02.591217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5bbb-bf24-442b-b2ff-1a910362a5cf None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.591731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5bbb-bf24-442b-b2ff-1a910362a5cf None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.592223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb5bbb-bf24-442b-b2ff-1a910362a5cf None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.593168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb5bbb-bf24-442b-b2ff-1a910362a5cf None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:02.593672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb5bbb-bf24-442b-b2ff-1a910362a5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:02.595261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb5bbb-bf24-442b-b2ff-1a910362a5cf None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:02.604613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6f4aa-4ac9-4341-aca3-a95d266d7d4c None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:02.610085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 403/792] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:02.611654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88444-cb06-4658-b756-b47295204251 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.612145 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88444-cb06-4658-b756-b47295204251 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.612639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88444-cb06-4658-b756-b47295204251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.629816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-c8f88444-cb06-4658-b756-b47295204251 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:02.631337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c8f88444-cb06-4658-b756-b47295204251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:02.640462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf961bf-ef16-434c-88c3-dd18c20fedd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:02.641193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf961bf-ef16-434c-88c3-dd18c20fedd2 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.641475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf961bf-ef16-434c-88c3-dd18c20fedd2 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.641751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf961bf-ef16-434c-88c3-dd18c20fedd2 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.642646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf961bf-ef16-434c-88c3-dd18c20fedd2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:02.643328 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf961bf-ef16-434c-88c3-dd18c20fedd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:02.644574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf961bf-ef16-434c-88c3-dd18c20fedd2 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:02.673544 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 390/793] 10.222.0.42 () {56 vars in 1135 bytes} [Fri May 27 13:40:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:02.674717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf961bf-ef16-434c-88c3-dd18c20fedd2 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:02.677442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:02.715092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 404/794] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:02.715092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f88444-cb06-4658-b756-b47295204251 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:02.810460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf961bf-ef16-434c-88c3-dd18c20fedd2 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:02.821187 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f88444-cb06-4658-b756-b47295204251 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:02.831345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:02.845851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2be670-8707-432d-8668-623f17001820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:02.849655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2be670-8707-432d-8668-623f17001820 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.849655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2be670-8707-432d-8668-623f17001820 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.849655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2be670-8707-432d-8668-623f17001820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.858127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aa9c4-4810-455d-8dcb-c9db43c4bea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:02.858621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2be670-8707-432d-8668-623f17001820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:02.859111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aa9c4-4810-455d-8dcb-c9db43c4bea4 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:02.859397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aa9c4-4810-455d-8dcb-c9db43c4bea4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:02.859667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aa9c4-4810-455d-8dcb-c9db43c4bea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:02.860152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2be670-8707-432d-8668-623f17001820 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:02.870768 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aa9c4-4810-455d-8dcb-c9db43c4bea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:02.872824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aa9c4-4810-455d-8dcb-c9db43c4bea4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-8e2be670-8707-432d-8668-623f17001820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:02.878653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:02.879563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:02.880447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:02.880447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:02.880447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:02.880447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:02.880447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 391/795] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:02.881131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2be670-8707-432d-8668-623f17001820 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-e77aa9c4-4810-455d-8dcb-c9db43c4bea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:02.894882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:02.896217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:02.897941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:02.897941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:02.897941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:02.897941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:02.903371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 405/796] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:02.904493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aa9c4-4810-455d-8dcb-c9db43c4bea4 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:02.944885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:02.987329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2be670-8707-432d-8668-623f17001820 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.010641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aa9c4-4810-455d-8dcb-c9db43c4bea4 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.026192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4457f-ca97-4acd-b617-e134da3de44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.027200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4457f-ca97-4acd-b617-e134da3de44b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.027587 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4457f-ca97-4acd-b617-e134da3de44b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.028084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4457f-ca97-4acd-b617-e134da3de44b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.039559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4457f-ca97-4acd-b617-e134da3de44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:03.046222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ecf76-9645-4ece-a8ba-dd2000a37aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.046884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ecf76-9645-4ece-a8ba-dd2000a37aa9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.047209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ecf76-9645-4ece-a8ba-dd2000a37aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.047483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ecf76-9645-4ece-a8ba-dd2000a37aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.048201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ecf76-9645-4ece-a8ba-dd2000a37aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-cde4457f-ca97-4acd-b617-e134da3de44b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:03.048400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:03.050440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:03.051858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:03.052647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ecf76-9645-4ece-a8ba-dd2000a37aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.052647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ecf76-9645-4ece-a8ba-dd2000a37aa9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.052805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 392/797] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:40:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:03.052805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4457f-ca97-4acd-b617-e134da3de44b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:03.064197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 406/798] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:03.065175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ecf76-9645-4ece-a8ba-dd2000a37aa9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:03.080157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:03.164353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4457f-ca97-4acd-b617-e134da3de44b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.174110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ecf76-9645-4ece-a8ba-dd2000a37aa9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.179738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:03.201715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d97c43-0bc9-47fa-b9f9-cfcc4b24d3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.202578 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97c43-0bc9-47fa-b9f9-cfcc4b24d3bf None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.203069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97c43-0bc9-47fa-b9f9-cfcc4b24d3bf None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.203351 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d97c43-0bc9-47fa-b9f9-cfcc4b24d3bf None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.204554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d97c43-0bc9-47fa-b9f9-cfcc4b24d3bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:03.205027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d97c43-0bc9-47fa-b9f9-cfcc4b24d3bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.206990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d97c43-0bc9-47fa-b9f9-cfcc4b24d3bf None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.211419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cfaec-df89-4fc0-972b-dfb02d657386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.212193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cfaec-df89-4fc0-972b-dfb02d657386 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.212578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cfaec-df89-4fc0-972b-dfb02d657386 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.212951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cfaec-df89-4fc0-972b-dfb02d657386 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.213794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cfaec-df89-4fc0-972b-dfb02d657386 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:03.214217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cfaec-df89-4fc0-972b-dfb02d657386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.216451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cfaec-df89-4fc0-972b-dfb02d657386 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.220961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 393/799] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:03.225312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d97c43-0bc9-47fa-b9f9-cfcc4b24d3bf None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:03.237542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 407/800] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:40:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:03.238592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cfaec-df89-4fc0-972b-dfb02d657386 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:03.335064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:03.341470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d97c43-0bc9-47fa-b9f9-cfcc4b24d3bf None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.369638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cfaec-df89-4fc0-972b-dfb02d657386 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.379030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1308a-e4b8-4e56-b18a-8c406fff987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.379954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1308a-e4b8-4e56-b18a-8c406fff987b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.380398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1308a-e4b8-4e56-b18a-8c406fff987b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.380677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1308a-e4b8-4e56-b18a-8c406fff987b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.390099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1308a-e4b8-4e56-b18a-8c406fff987b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.391844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1308a-e4b8-4e56-b18a-8c406fff987b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-6fe1308a-e4b8-4e56-b18a-8c406fff987b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:03.409296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:03.410271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:03.411277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:03.411277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:03.411277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:03.411277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:03.411277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:03.411277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:03.411277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:03.411277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:03.411277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:40:03.411277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:03.411827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb6365-be78-45bc-9f62-18d850c74f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.411827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6365-be78-45bc-9f62-18d850c74f13 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.411994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 394/801] 10.222.0.42 () {56 vars in 1117 bytes} [Fri May 27 13:40:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:03.412073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6365-be78-45bc-9f62-18d850c74f13 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.412073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb6365-be78-45bc-9f62-18d850c74f13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.412206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1308a-e4b8-4e56-b18a-8c406fff987b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:03.421556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb6365-be78-45bc-9f62-18d850c74f13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.423714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb6365-be78-45bc-9f62-18d850c74f13 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-5bfb6365-be78-45bc-9f62-18d850c74f13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:03.445848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:03.447021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:03.448813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:03.448813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:03.448813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:03.448813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:03.448813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:03.448813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:03.448813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:03.448813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:03.448813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 408/802] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:03.449787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb6365-be78-45bc-9f62-18d850c74f13 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:03.459054 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:03.533325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1308a-e4b8-4e56-b18a-8c406fff987b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.571667 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dba635-705a-4f9d-ad24-38a939104ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.572473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dba635-705a-4f9d-ad24-38a939104ebc None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.572753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dba635-705a-4f9d-ad24-38a939104ebc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.573029 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dba635-705a-4f9d-ad24-38a939104ebc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.584793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dba635-705a-4f9d-ad24-38a939104ebc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.586284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dba635-705a-4f9d-ad24-38a939104ebc None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.588684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb6365-be78-45bc-9f62-18d850c74f13 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-01dba635-705a-4f9d-ad24-38a939104ebc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:03.605433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:03.607622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:03.609766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:03.609766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:03.609766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:03.609766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:03.609766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 395/803] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:03.609766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dba635-705a-4f9d-ad24-38a939104ebc None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:03.630037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b4be-5fca-45ff-ae58-eb5b50c8abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.630707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b4be-5fca-45ff-ae58-eb5b50c8abb8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.631022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b4be-5fca-45ff-ae58-eb5b50c8abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.631307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3b4be-5fca-45ff-ae58-eb5b50c8abb8 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.632152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3b4be-5fca-45ff-ae58-eb5b50c8abb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:03.632462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3b4be-5fca-45ff-ae58-eb5b50c8abb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.633891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3b4be-5fca-45ff-ae58-eb5b50c8abb8 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.635694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:03.654446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 409/804] 10.222.0.42 () {56 vars in 1149 bytes} [Fri May 27 13:40:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:03.655384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b4be-5fca-45ff-ae58-eb5b50c8abb8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:03.712207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:03.728432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dba635-705a-4f9d-ad24-38a939104ebc None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.756618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3b4be-5fca-45ff-ae58-eb5b50c8abb8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.766079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d9aea-38f3-4070-9d9e-b7a5fb0b4308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.766744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d9aea-38f3-4070-9d9e-b7a5fb0b4308 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.767053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d9aea-38f3-4070-9d9e-b7a5fb0b4308 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.767334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d9aea-38f3-4070-9d9e-b7a5fb0b4308 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.768124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d9aea-38f3-4070-9d9e-b7a5fb0b4308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:03.768438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d9aea-38f3-4070-9d9e-b7a5fb0b4308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.769873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d9aea-38f3-4070-9d9e-b7a5fb0b4308 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.787278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 396/805] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:03.787278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd96d6-c19d-47b3-bcae-0e1fe0f18e67 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.787278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd96d6-c19d-47b3-bcae-0e1fe0f18e67 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.787278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd96d6-c19d-47b3-bcae-0e1fe0f18e67 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.787278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 397/806] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:03.787278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd96d6-c19d-47b3-bcae-0e1fe0f18e67 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:03.802393 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1c98-6d34-44e4-b49e-d3b491a795c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.803088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1c98-6d34-44e4-b49e-d3b491a795c8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.803366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1c98-6d34-44e4-b49e-d3b491a795c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.803641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a1c98-6d34-44e4-b49e-d3b491a795c8 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.804360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a1c98-6d34-44e4-b49e-d3b491a795c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:03.804688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a1c98-6d34-44e4-b49e-d3b491a795c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.806045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a1c98-6d34-44e4-b49e-d3b491a795c8 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.818546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 410/807] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:03.819356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1c98-6d34-44e4-b49e-d3b491a795c8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:03.873485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:03.916517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd96d6-c19d-47b3-bcae-0e1fe0f18e67 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.926427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a1c98-6d34-44e4-b49e-d3b491a795c8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:03.953247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b6447-387e-477c-a95f-f16d4e7d666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.954038 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b6447-387e-477c-a95f-f16d4e7d666a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.954320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b6447-387e-477c-a95f-f16d4e7d666a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.954596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b6447-387e-477c-a95f-f16d4e7d666a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.962190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc76049-fa8b-40d5-8ae4-0a5948350571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:03.963108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc76049-fa8b-40d5-8ae4-0a5948350571 None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.963396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc76049-fa8b-40d5-8ae4-0a5948350571 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.963668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc76049-fa8b-40d5-8ae4-0a5948350571 None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/d8ea258578544e5c8f05b751d31e0f34/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:03.965774 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b6447-387e-477c-a95f-f16d4e7d666a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.965898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc76049-fa8b-40d5-8ae4-0a5948350571 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=d8ea258578544e5c8f05b751d31e0f34, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:03.967350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc76049-fa8b-40d5-8ae4-0a5948350571 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.967730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b6447-387e-477c-a95f-f16d4e7d666a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:03.974767 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-a39b6447-387e-477c-a95f-f16d4e7d666a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:03.986101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:03.990736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:03.991887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:03.991887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:03.991887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:03.991887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:03.991887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 398/808] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:03.991887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7425-57f5-4f71-8cc3-222bbe029602 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:03.991887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7425-57f5-4f71-8cc3-222bbe029602 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:03.991887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7425-57f5-4f71-8cc3-222bbe029602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.007262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-aacc7425-57f5-4f71-8cc3-222bbe029602 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:04.008437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-aacc7425-57f5-4f71-8cc3-222bbe029602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:04.063837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 411/809] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:40:03 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/d8ea258578544e5c8f05b751d31e0f34/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:40:04.064804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc76049-fa8b-40d5-8ae4-0a5948350571 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:04.080235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 399/810] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:04.081448 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7425-57f5-4f71-8cc3-222bbe029602 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:04.203392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7425-57f5-4f71-8cc3-222bbe029602 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:04.214504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc76049-fa8b-40d5-8ae4-0a5948350571 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:04.232040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:04.235963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:04.244007 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7963a-a2e4-47a2-b8d1-e6e5e41c1884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:04.244690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7963a-a2e4-47a2-b8d1-e6e5e41c1884 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.244972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7963a-a2e4-47a2-b8d1-e6e5e41c1884 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.259447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7963a-a2e4-47a2-b8d1-e6e5e41c1884 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.259447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7963a-a2e4-47a2-b8d1-e6e5e41c1884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:04.259447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7963a-a2e4-47a2-b8d1-e6e5e41c1884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:04.259447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7963a-a2e4-47a2-b8d1-e6e5e41c1884 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:04.259784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4da34f-0946-40c4-bf9d-f6ae4080bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:04.259784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da34f-0946-40c4-bf9d-f6ae4080bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.259784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da34f-0946-40c4-bf9d-f6ae4080bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.259784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4da34f-0946-40c4-bf9d-f6ae4080bcf7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.264465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 400/811] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:04.264465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0240874-6182-4d72-b454-554b7a4446ad None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.264465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0240874-6182-4d72-b454-554b7a4446ad None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.264465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0240874-6182-4d72-b454-554b7a4446ad None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.265215 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 401/812] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:04.266027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0240874-6182-4d72-b454-554b7a4446ad None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:04.272753 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4da34f-0946-40c4-bf9d-f6ae4080bcf7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:04.274285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4da34f-0946-40c4-bf9d-f6ae4080bcf7 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-9a4da34f-0946-40c4-bf9d-f6ae4080bcf7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:04.290675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:04.294617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 412/813] 10.222.0.42 () {56 vars in 1093 bytes} [Fri May 27 13:40:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:04.295718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4da34f-0946-40c4-bf9d-f6ae4080bcf7 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:04.385311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0240874-6182-4d72-b454-554b7a4446ad None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:04.402437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4da34f-0946-40c4-bf9d-f6ae4080bcf7 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:04.422743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc7a92-c3c5-47ef-a372-43737e6270ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:04.423597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7a92-c3c5-47ef-a372-43737e6270ff None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.423892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7a92-c3c5-47ef-a372-43737e6270ff None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.424170 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc7a92-c3c5-47ef-a372-43737e6270ff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.425094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc7a92-c3c5-47ef-a372-43737e6270ff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:04.426476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc7a92-c3c5-47ef-a372-43737e6270ff None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:04.439402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f93ba-c266-4603-94af-31ce040b0179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-addc7a92-c3c5-47ef-a372-43737e6270ff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:04.439873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:04.440820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 13:40:04.441664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:04.442444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f93ba-c266-4603-94af-31ce040b0179 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.442444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f93ba-c266-4603-94af-31ce040b0179 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.442444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f93ba-c266-4603-94af-31ce040b0179 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.442633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 402/814] 10.222.0.42 () {56 vars in 1129 bytes} [Fri May 27 13:40:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:04.442633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1320c0-1d2c-439c-8ee6-38b7034d8a25 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.442763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1320c0-1d2c-439c-8ee6-38b7034d8a25 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.443100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1320c0-1d2c-439c-8ee6-38b7034d8a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.450390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f93ba-c266-4603-94af-31ce040b0179 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:04.451870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f93ba-c266-4603-94af-31ce040b0179 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:04.461499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fc1320c0-1d2c-439c-8ee6-38b7034d8a25 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:04.462693 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fc1320c0-1d2c-439c-8ee6-38b7034d8a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-620f93ba-c266-4603-94af-31ce040b0179 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:04.466564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:04.467494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:04.468367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:04.468367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:04.468367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:04.468367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:04.468367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:04.468367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:04.468367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:04.468367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:04.471489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 413/815] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:04.472046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f93ba-c266-4603-94af-31ce040b0179 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:04.504821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:04.523154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:04.555011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 403/816] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:04.555011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1320c0-1d2c-439c-8ee6-38b7034d8a25 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:04.582473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f93ba-c266-4603-94af-31ce040b0179 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:04.621260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b857e1-51c7-4544-a5e6-6895bef622db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:04.621976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b857e1-51c7-4544-a5e6-6895bef622db None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.622255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b857e1-51c7-4544-a5e6-6895bef622db None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.622530 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b857e1-51c7-4544-a5e6-6895bef622db None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.623395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b857e1-51c7-4544-a5e6-6895bef622db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:04.623706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b857e1-51c7-4544-a5e6-6895bef622db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:04.625134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b857e1-51c7-4544-a5e6-6895bef622db None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:04.642426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 414/817] 10.222.0.42 () {56 vars in 1133 bytes} [Fri May 27 13:40:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:04.643198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b857e1-51c7-4544-a5e6-6895bef622db None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:04.672433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1320c0-1d2c-439c-8ee6-38b7034d8a25 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:04.710183 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4810cea-9642-4d7f-a54b-a741996d4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:04.711016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4810cea-9642-4d7f-a54b-a741996d4070 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.711377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4810cea-9642-4d7f-a54b-a741996d4070 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.711715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4810cea-9642-4d7f-a54b-a741996d4070 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.712488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4810cea-9642-4d7f-a54b-a741996d4070 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:04.712863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4810cea-9642-4d7f-a54b-a741996d4070 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:04.714249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4810cea-9642-4d7f-a54b-a741996d4070 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:04.718825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 404/818] 10.222.0.42 () {56 vars in 1124 bytes} [Fri May 27 13:40:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:04.719626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4810cea-9642-4d7f-a54b-a741996d4070 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:04.750211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:04.759604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b857e1-51c7-4544-a5e6-6895bef622db None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:04.769903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:04.795439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb221aa-09a8-4294-a8e0-aa5c87fc455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:04.796099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb221aa-09a8-4294-a8e0-aa5c87fc455d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.796396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb221aa-09a8-4294-a8e0-aa5c87fc455d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.796649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb221aa-09a8-4294-a8e0-aa5c87fc455d None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.797426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb221aa-09a8-4294-a8e0-aa5c87fc455d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:04.797729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb221aa-09a8-4294-a8e0-aa5c87fc455d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:04.799168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb221aa-09a8-4294-a8e0-aa5c87fc455d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:04.812610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 415/819] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:04.813492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb221aa-09a8-4294-a8e0-aa5c87fc455d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:04.830415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4810cea-9642-4d7f-a54b-a741996d4070 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:04.865361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480837df-056a-4236-a586-dcf9685f6981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:04.866164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480837df-056a-4236-a586-dcf9685f6981 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.866444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480837df-056a-4236-a586-dcf9685f6981 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.866706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480837df-056a-4236-a586-dcf9685f6981 None admin] PATH_INFO: `/v3/services/network` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.867417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480837df-056a-4236-a586-dcf9685f6981 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:04.868765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480837df-056a-4236-a586-dcf9685f6981 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-480837df-056a-4236-a586-dcf9685f6981 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:04.881149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:04.882180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:04.883091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 405/820] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:04 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:04.883927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480837df-056a-4236-a586-dcf9685f6981 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:04.923634 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb221aa-09a8-4294-a8e0-aa5c87fc455d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:04.958413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc10a2-edb1-47e9-b593-d6dc935d25ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:04.959083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc10a2-edb1-47e9-b593-d6dc935d25ec None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:04.959362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc10a2-edb1-47e9-b593-d6dc935d25ec None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:04.959635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc10a2-edb1-47e9-b593-d6dc935d25ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:04.978735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:04.987488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480837df-056a-4236-a586-dcf9685f6981 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:04.998570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:05.023606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba46b0-b535-4934-bf60-ebacc9d4591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:05.024275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba46b0-b535-4934-bf60-ebacc9d4591a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:05.024570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba46b0-b535-4934-bf60-ebacc9d4591a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:05.024851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba46b0-b535-4934-bf60-ebacc9d4591a None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:05.025563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba46b0-b535-4934-bf60-ebacc9d4591a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:05.025892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba46b0-b535-4934-bf60-ebacc9d4591a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:05.027309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba46b0-b535-4934-bf60-ebacc9d4591a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:05.033264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 406/821] 10.222.0.42 () {56 vars in 1124 bytes} [Fri May 27 13:40:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:05.033910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba46b0-b535-4934-bf60-ebacc9d4591a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:05.037120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc10a2-edb1-47e9-b593-d6dc935d25ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:05.038890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc10a2-edb1-47e9-b593-d6dc935d25ec None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:05.148666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba46b0-b535-4934-bf60-ebacc9d4591a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:05.151212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 416/822] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:40:05.152342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc10a2-edb1-47e9-b593-d6dc935d25ec None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:05.189568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1ba6b-42bd-4503-97bc-3e42bd32ca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:05.190595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ba6b-42bd-4503-97bc-3e42bd32ca34 None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:05.190882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ba6b-42bd-4503-97bc-3e42bd32ca34 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:05.191196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1ba6b-42bd-4503-97bc-3e42bd32ca34 None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/604a6139cec24af6a40c5eee3f197b7b/roles/416e51d61cb34bff89839f6703558c2b` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:05.208594 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:05.216169 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1ba6b-42bd-4503-97bc-3e42bd32ca34 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=604a6139cec24af6a40c5eee3f197b7b, role_id=416e51d61cb34bff89839f6703558c2b)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:05.216169 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1ba6b-42bd-4503-97bc-3e42bd32ca34 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:05.260285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc10a2-edb1-47e9-b593-d6dc935d25ec None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:05.294286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb1d7-a866-4faa-bc2e-c822f6797e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:05.295117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb1d7-a866-4faa-bc2e-c822f6797e54 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:05.295403 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb1d7-a866-4faa-bc2e-c822f6797e54 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:05.295675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fb1d7-a866-4faa-bc2e-c822f6797e54 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:05.296375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fb1d7-a866-4faa-bc2e-c822f6797e54 None admin] RBAC: Adding query filter params (name=network) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:05.304549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fb1d7-a866-4faa-bc2e-c822f6797e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:05.304740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 407/823] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:40:05 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/604a6139cec24af6a40c5eee3f197b7b/roles/416e51d61cb34bff89839f6703558c2b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:40:05.304740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1ba6b-42bd-4503-97bc-3e42bd32ca34 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:05.304914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7fb1d7-a866-4faa-bc2e-c822f6797e54 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:05.304914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 417/824] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:05.304914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb1d7-a866-4faa-bc2e-c822f6797e54 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:05.351100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:05.429582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fb1d7-a866-4faa-bc2e-c822f6797e54 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:05.445836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:05.468475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22da88-bb7a-439e-a5c1-0c2262337cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:05.469362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1ba6b-42bd-4503-97bc-3e42bd32ca34 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:05.469490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22da88-bb7a-439e-a5c1-0c2262337cbf None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:05.469822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22da88-bb7a-439e-a5c1-0c2262337cbf None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:05.470161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22da88-bb7a-439e-a5c1-0c2262337cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:05.483774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22da88-bb7a-439e-a5c1-0c2262337cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:05.485353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22da88-bb7a-439e-a5c1-0c2262337cbf None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ad22da88-bb7a-439e-a5c1-0c2262337cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:05.504954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:05.506077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:05.507221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:05.507221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:05.507221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:05.507221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:05.507221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 418/825] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:05.507652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22da88-bb7a-439e-a5c1-0c2262337cbf None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:05.517764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717975ee-d8de-40a0-a86f-8611e88d3de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:05.519301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717975ee-d8de-40a0-a86f-8611e88d3de5 None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:05.519763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717975ee-d8de-40a0-a86f-8611e88d3de5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:05.520190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717975ee-d8de-40a0-a86f-8611e88d3de5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:05.521550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717975ee-d8de-40a0-a86f-8611e88d3de5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:05.523802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717975ee-d8de-40a0-a86f-8611e88d3de5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:05.624275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22da88-bb7a-439e-a5c1-0c2262337cbf None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:05.654881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 408/826] 10.222.0.42 () {60 vars in 1144 bytes} [Fri May 27 13:40:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:40:05.656382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717975ee-d8de-40a0-a86f-8611e88d3de5 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:05.668478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e462d3-9d0e-44b9-b617-087e0d9f2f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:05.669205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e462d3-9d0e-44b9-b617-087e0d9f2f0b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:05.669490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e462d3-9d0e-44b9-b617-087e0d9f2f0b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:05.669798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e462d3-9d0e-44b9-b617-087e0d9f2f0b None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:05.670676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e462d3-9d0e-44b9-b617-087e0d9f2f0b None admin] RBAC: Adding query filter params (type=network) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:05.671236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e462d3-9d0e-44b9-b617-087e0d9f2f0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:05.672758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e462d3-9d0e-44b9-b617-087e0d9f2f0b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:05.679579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 419/827] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:05.692077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e462d3-9d0e-44b9-b617-087e0d9f2f0b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:05.765281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:05.773901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:05.803651 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717975ee-d8de-40a0-a86f-8611e88d3de5 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:05.853907 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603c8bb-a933-4b6e-b33e-025e7c860a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:05.854589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603c8bb-a933-4b6e-b33e-025e7c860a0a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:05.854876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603c8bb-a933-4b6e-b33e-025e7c860a0a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:05.855177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603c8bb-a933-4b6e-b33e-025e7c860a0a None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:05.857209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603c8bb-a933-4b6e-b33e-025e7c860a0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:05.857209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603c8bb-a933-4b6e-b33e-025e7c860a0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:05.863622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603c8bb-a933-4b6e-b33e-025e7c860a0a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:05.876571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 409/828] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:05.879331 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e462d3-9d0e-44b9-b617-087e0d9f2f0b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:05.882062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603c8bb-a933-4b6e-b33e-025e7c860a0a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:05.921352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b4a4-2e6a-4664-a643-7383ad054f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:05.922453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b4a4-2e6a-4664-a643-7383ad054f9a None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:05.922986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b4a4-2e6a-4664-a643-7383ad054f9a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:05.923618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b4a4-2e6a-4664-a643-7383ad054f9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:05.924814 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0b4a4-2e6a-4664-a643-7383ad054f9a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:05.926820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0b4a4-2e6a-4664-a643-7383ad054f9a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:06.017507 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603c8bb-a933-4b6e-b33e-025e7c860a0a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:06.029140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 420/829] 10.222.0.42 () {60 vars in 1144 bytes} [Fri May 27 13:40:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:40:06.072891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af294e36-7e45-45d8-be76-f5254bf5afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:06.074048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294e36-7e45-45d8-be76-f5254bf5afc5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:06.074623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294e36-7e45-45d8-be76-f5254bf5afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:06.075173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af294e36-7e45-45d8-be76-f5254bf5afc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:06.078783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:06.084150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af294e36-7e45-45d8-be76-f5254bf5afc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:06.085922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af294e36-7e45-45d8-be76-f5254bf5afc5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-af294e36-7e45-45d8-be76-f5254bf5afc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:06.102023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:06.103036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:06.104024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:06.104024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:06.104024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:06.104024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:06.104024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:06.104024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:06.104024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:06.104024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:06.106838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 410/830] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:06.113158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b4a4-2e6a-4664-a643-7383ad054f9a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:06.216379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:06.238022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b4a4-2e6a-4664-a643-7383ad054f9a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:06.278368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792961f8-b69c-4b89-be4e-3f280eda7d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:06.279503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792961f8-b69c-4b89-be4e-3f280eda7d34 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:06.280009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792961f8-b69c-4b89-be4e-3f280eda7d34 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:06.280520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792961f8-b69c-4b89-be4e-3f280eda7d34 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:06.281613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792961f8-b69c-4b89-be4e-3f280eda7d34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:06.282151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792961f8-b69c-4b89-be4e-3f280eda7d34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:06.284110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792961f8-b69c-4b89-be4e-3f280eda7d34 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:06.298812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 421/831] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:06.305839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af294e36-7e45-45d8-be76-f5254bf5afc5 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:06.413798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592c021-acda-4a1d-b595-efc4a4000088 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:06.414455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592c021-acda-4a1d-b595-efc4a4000088 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:06.414956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592c021-acda-4a1d-b595-efc4a4000088 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:06.421205 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af294e36-7e45-45d8-be76-f5254bf5afc5 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:06.422009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 422/832] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:06.423510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9857a4-f816-46c2-b3c2-4138f3ff0ab3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:06.423998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9857a4-f816-46c2-b3c2-4138f3ff0ab3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:06.424722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9857a4-f816-46c2-b3c2-4138f3ff0ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:06.441828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-1b9857a4-f816-46c2-b3c2-4138f3ff0ab3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:06.443426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1b9857a4-f816-46c2-b3c2-4138f3ff0ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:06.458419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbe840-b91b-4e2f-93d4-753e5752c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:06.459150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbe840-b91b-4e2f-93d4-753e5752c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:06.459434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbe840-b91b-4e2f-93d4-753e5752c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:06.459710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbe840-b91b-4e2f-93d4-753e5752c2b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:06.460653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbe840-b91b-4e2f-93d4-753e5752c2b1 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=9a1644fa5cd3499d9d6ad057067255e9) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:06.461019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbe840-b91b-4e2f-93d4-753e5752c2b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:06.462577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbe840-b91b-4e2f-93d4-753e5752c2b1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:06.469939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 411/833] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:06 2022] GET /identity/v3/role_assignments?user.id=9a1644fa5cd3499d9d6ad057067255e9&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=3951cc86a51d416fafc5676d456e79ce => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:06.536630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 423/834] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:06.564706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbe840-b91b-4e2f-93d4-753e5752c2b1 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:06.640862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:06.692786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbe840-b91b-4e2f-93d4-753e5752c2b1 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:06.739486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef59cbc-b208-4c8c-9b23-b7a7e6b6298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:06.740597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef59cbc-b208-4c8c-9b23-b7a7e6b6298c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:06.741024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef59cbc-b208-4c8c-9b23-b7a7e6b6298c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:06.741435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef59cbc-b208-4c8c-9b23-b7a7e6b6298c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:06.753213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef59cbc-b208-4c8c-9b23-b7a7e6b6298c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-4ef59cbc-b208-4c8c-9b23-b7a7e6b6298c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:06.762543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:06.764320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:06.765469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:06.766896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 412/835] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:40:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:06.772417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9857a4-f816-46c2-b3c2-4138f3ff0ab3 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:06.853117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:06.886252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9857a4-f816-46c2-b3c2-4138f3ff0ab3 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:06.924148 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8fad-5b2e-4596-b76a-c8c9f2810c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:06.925077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8fad-5b2e-4596-b76a-c8c9f2810c79 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:06.925615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8fad-5b2e-4596-b76a-c8c9f2810c79 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:06.925615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8fad-5b2e-4596-b76a-c8c9f2810c79 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:06.926337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc8fad-5b2e-4596-b76a-c8c9f2810c79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:06.926638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc8fad-5b2e-4596-b76a-c8c9f2810c79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:06.928181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc8fad-5b2e-4596-b76a-c8c9f2810c79 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:06.936963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 424/836] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:06.942408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef59cbc-b208-4c8c-9b23-b7a7e6b6298c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:07.051204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef59cbc-b208-4c8c-9b23-b7a7e6b6298c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:07.072003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:07.086703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45e14a-4f6f-4258-a4c8-7addb6d64225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:07.087527 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e14a-4f6f-4258-a4c8-7addb6d64225 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:07.087808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e14a-4f6f-4258-a4c8-7addb6d64225 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:07.088083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45e14a-4f6f-4258-a4c8-7addb6d64225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:07.100419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45e14a-4f6f-4258-a4c8-7addb6d64225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:07.101942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45e14a-4f6f-4258-a4c8-7addb6d64225 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-cb45e14a-4f6f-4258-a4c8-7addb6d64225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:07.122591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:07.123553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:07.124438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:07.124438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:07.124438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:07.124438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:07.124659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 413/837] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:07.130177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8fad-5b2e-4596-b76a-c8c9f2810c79 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:07.238825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8fad-5b2e-4596-b76a-c8c9f2810c79 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:07.274479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97ee1-8124-46a1-a3fc-ee88b4dc572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:07.275176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97ee1-8124-46a1-a3fc-ee88b4dc572a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:07.275456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97ee1-8124-46a1-a3fc-ee88b4dc572a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:07.275726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97ee1-8124-46a1-a3fc-ee88b4dc572a None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:07.276500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97ee1-8124-46a1-a3fc-ee88b4dc572a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:07.276807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97ee1-8124-46a1-a3fc-ee88b4dc572a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:07.278550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97ee1-8124-46a1-a3fc-ee88b4dc572a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:07.280125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:07.292465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 425/838] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:07.300316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45e14a-4f6f-4258-a4c8-7addb6d64225 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:07.410798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45e14a-4f6f-4258-a4c8-7addb6d64225 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:07.446156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80aacb-e267-46d8-a2b6-4219bf0d0440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:07.447064 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80aacb-e267-46d8-a2b6-4219bf0d0440 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:07.447352 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80aacb-e267-46d8-a2b6-4219bf0d0440 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:07.447629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80aacb-e267-46d8-a2b6-4219bf0d0440 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:07.456186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80aacb-e267-46d8-a2b6-4219bf0d0440 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:07.457647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80aacb-e267-46d8-a2b6-4219bf0d0440 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-aa80aacb-e267-46d8-a2b6-4219bf0d0440 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:07.473313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:07.475465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:07.477628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 414/839] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:40:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:07.480192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97ee1-8124-46a1-a3fc-ee88b4dc572a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:07.589559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97ee1-8124-46a1-a3fc-ee88b4dc572a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:07.629474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd2f9a-4b47-4e31-94d4-10920e41111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:07.630202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd2f9a-4b47-4e31-94d4-10920e41111d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:07.630492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd2f9a-4b47-4e31-94d4-10920e41111d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:07.630763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd2f9a-4b47-4e31-94d4-10920e41111d None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:07.631771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd2f9a-4b47-4e31-94d4-10920e41111d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:07.632081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd2f9a-4b47-4e31-94d4-10920e41111d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:07.633533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd2f9a-4b47-4e31-94d4-10920e41111d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:07.653596 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 426/840] 10.222.0.42 () {56 vars in 1135 bytes} [Fri May 27 13:40:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:07.659238 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80aacb-e267-46d8-a2b6-4219bf0d0440 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:07.696665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:07.777523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80aacb-e267-46d8-a2b6-4219bf0d0440 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:07.816510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ee175-1bfe-4d40-a544-3029bc8fcd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:07.817518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ee175-1bfe-4d40-a544-3029bc8fcd50 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:07.818036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ee175-1bfe-4d40-a544-3029bc8fcd50 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:07.818518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ee175-1bfe-4d40-a544-3029bc8fcd50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:07.844562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc5d68-f6f3-4545-be98-13d03012b7e8 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:07.845237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc5d68-f6f3-4545-be98-13d03012b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:07.845714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc5d68-f6f3-4545-be98-13d03012b7e8 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:07.847740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 427/841] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:07.855967 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190ec64-59f3-47ea-8f02-2d5cc9593450 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:07.856434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190ec64-59f3-47ea-8f02-2d5cc9593450 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:07.856717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190ec64-59f3-47ea-8f02-2d5cc9593450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:07.874557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-4190ec64-59f3-47ea-8f02-2d5cc9593450 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:07.875917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4190ec64-59f3-47ea-8f02-2d5cc9593450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:07.902463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ee175-1bfe-4d40-a544-3029bc8fcd50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:07.905048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ee175-1bfe-4d40-a544-3029bc8fcd50 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:07.925243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:07.941737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:07.951430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 428/842] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:07.970209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190ec64-59f3-47ea-8f02-2d5cc9593450 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.017429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 415/843] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:40:08.022776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ee175-1bfe-4d40-a544-3029bc8fcd50 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.085965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190ec64-59f3-47ea-8f02-2d5cc9593450 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.121209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da2c15-d233-4ce3-88f9-c4065d933759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:08.122056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da2c15-d233-4ce3-88f9-c4065d933759 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.122343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da2c15-d233-4ce3-88f9-c4065d933759 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.122763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60da2c15-d233-4ce3-88f9-c4065d933759 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.133425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60da2c15-d233-4ce3-88f9-c4065d933759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:08.139895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ee175-1bfe-4d40-a544-3029bc8fcd50 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-60da2c15-d233-4ce3-88f9-c4065d933759 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:08.141910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:08.142823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:40:08.143698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:08.147405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 429/844] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:40:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:08.149159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da2c15-d233-4ce3-88f9-c4065d933759 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.177567 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:08.183947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3531893-cbac-42bf-9112-6dbee6c89731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:08.185096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3531893-cbac-42bf-9112-6dbee6c89731 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.185588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3531893-cbac-42bf-9112-6dbee6c89731 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.186167 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3531893-cbac-42bf-9112-6dbee6c89731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.195624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:08.198708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3531893-cbac-42bf-9112-6dbee6c89731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:08.201338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3531893-cbac-42bf-9112-6dbee6c89731 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-f3531893-cbac-42bf-9112-6dbee6c89731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:08.221166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:08.222138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:08.223079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:08.223079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:08.223079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:08.223079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:08.225385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 416/845] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:08.232243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3531893-cbac-42bf-9112-6dbee6c89731 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.261524 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60da2c15-d233-4ce3-88f9-c4065d933759 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.298483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020af13-afc7-45ae-a478-7c77ea6a4860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:08.299182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020af13-afc7-45ae-a478-7c77ea6a4860 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.299736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020af13-afc7-45ae-a478-7c77ea6a4860 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.300017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020af13-afc7-45ae-a478-7c77ea6a4860 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.300762 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020af13-afc7-45ae-a478-7c77ea6a4860 None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:08.301070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020af13-afc7-45ae-a478-7c77ea6a4860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:08.302771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020af13-afc7-45ae-a478-7c77ea6a4860 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:08.316121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 430/846] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:40:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:08.316121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d7cb2-1e81-44b4-a94c-e1f02b59b8c2 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.316121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d7cb2-1e81-44b4-a94c-e1f02b59b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.316121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d7cb2-1e81-44b4-a94c-e1f02b59b8c2 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.316121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 431/847] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:08.319812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d7cb2-1e81-44b4-a94c-e1f02b59b8c2 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.345149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3531893-cbac-42bf-9112-6dbee6c89731 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.384080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04581b72-8c41-4a61-b1ef-c6d8be25d859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:08.384754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04581b72-8c41-4a61-b1ef-c6d8be25d859 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.385042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04581b72-8c41-4a61-b1ef-c6d8be25d859 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.385322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04581b72-8c41-4a61-b1ef-c6d8be25d859 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.386051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04581b72-8c41-4a61-b1ef-c6d8be25d859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:08.386364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04581b72-8c41-4a61-b1ef-c6d8be25d859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:08.388183 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04581b72-8c41-4a61-b1ef-c6d8be25d859 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:08.405408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 417/848] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:08.405408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d861-09f8-4f0d-b80e-3de551ebd2a9 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.405408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d861-09f8-4f0d-b80e-3de551ebd2a9 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.405408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823d861-09f8-4f0d-b80e-3de551ebd2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.421202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-1823d861-09f8-4f0d-b80e-3de551ebd2a9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:08.422409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1823d861-09f8-4f0d-b80e-3de551ebd2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:08.431918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d7cb2-1e81-44b4-a94c-e1f02b59b8c2 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.435138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:08.468224 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:08.470416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0edeee-87ec-4189-a286-8631c8ce7a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:08.471486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0edeee-87ec-4189-a286-8631c8ce7a3c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.471942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0edeee-87ec-4189-a286-8631c8ce7a3c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.472371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0edeee-87ec-4189-a286-8631c8ce7a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.482631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0edeee-87ec-4189-a286-8631c8ce7a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:08.484109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0edeee-87ec-4189-a286-8631c8ce7a3c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:08.497023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 418/849] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:08.502331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d861-09f8-4f0d-b80e-3de551ebd2a9 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-5f0edeee-87ec-4189-a286-8631c8ce7a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:08.503375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:08.504245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:08.505129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:08.505129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:08.505129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:08.505129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:08.509138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 432/850] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:08.509997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0edeee-87ec-4189-a286-8631c8ce7a3c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.614278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823d861-09f8-4f0d-b80e-3de551ebd2a9 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.616482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0edeee-87ec-4189-a286-8631c8ce7a3c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.652038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6d349-fa64-44b1-a003-edd886629dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:08.653251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6d349-fa64-44b1-a003-edd886629dfb None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.653539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6d349-fa64-44b1-a003-edd886629dfb None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.653799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377d05a-bfc2-4026-82b5-fa855c260c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:08.653923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6d349-fa64-44b1-a003-edd886629dfb None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.654522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6d349-fa64-44b1-a003-edd886629dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:08.654684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377d05a-bfc2-4026-82b5-fa855c260c7d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.654849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6d349-fa64-44b1-a003-edd886629dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:08.654940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377d05a-bfc2-4026-82b5-fa855c260c7d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.655258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377d05a-bfc2-4026-82b5-fa855c260c7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.656226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6d349-fa64-44b1-a003-edd886629dfb None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:08.662517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377d05a-bfc2-4026-82b5-fa855c260c7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:08.664002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377d05a-bfc2-4026-82b5-fa855c260c7d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:08.672780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 433/851] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:08.673881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6d349-fa64-44b1-a003-edd886629dfb None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-7377d05a-bfc2-4026-82b5-fa855c260c7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:08.682452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:08.683580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:08.684469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:08.684469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:08.684469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:08.684469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:08.684469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:08.684469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:08.684469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:08.684469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:08.684469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 419/852] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:08.685053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377d05a-bfc2-4026-82b5-fa855c260c7d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.703279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:08.731341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:08.789920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6d349-fa64-44b1-a003-edd886629dfb None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.798795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377d05a-bfc2-4026-82b5-fa855c260c7d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.825458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e1b33-dfc2-4b36-9750-d41e8b011fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:08.826256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e1b33-dfc2-4b36-9750-d41e8b011fdf None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.826539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e1b33-dfc2-4b36-9750-d41e8b011fdf None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.826817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e1b33-dfc2-4b36-9750-d41e8b011fdf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.827501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e1b33-dfc2-4b36-9750-d41e8b011fdf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:08.828874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e1b33-dfc2-4b36-9750-d41e8b011fdf None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:08.834842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8da37-8d95-4c24-878e-d3819b485a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:08.835688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8da37-8d95-4c24-878e-d3819b485a6f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.835976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8da37-8d95-4c24-878e-d3819b485a6f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.836253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8da37-8d95-4c24-878e-d3819b485a6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-bf3e1b33-dfc2-4b36-9750-d41e8b011fdf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:08.841544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:08.842508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:08.848585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 434/853] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:40:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:08.849361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e1b33-dfc2-4b36-9750-d41e8b011fdf None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.849442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8da37-8d95-4c24-878e-d3819b485a6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:08.849442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8da37-8d95-4c24-878e-d3819b485a6f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-cbf8da37-8d95-4c24-878e-d3819b485a6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:08.864100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:08.865067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:08.865991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:08.865991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:08.865991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:08.865991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:08.865991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:08.865991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:08.865991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:08.865991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:08.865991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:40:08.865991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:08.868614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 420/854] 10.222.0.42 () {56 vars in 1117 bytes} [Fri May 27 13:40:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:08.869583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8da37-8d95-4c24-878e-d3819b485a6f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:08.940000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:08.959546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e1b33-dfc2-4b36-9750-d41e8b011fdf None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.964057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:08.971316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8da37-8d95-4c24-878e-d3819b485a6f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:08.994606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023eeca-5e70-44f2-9e76-d05b4e42506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:08.995222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023eeca-5e70-44f2-9e76-d05b4e42506e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:08.995518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023eeca-5e70-44f2-9e76-d05b4e42506e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:08.995794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023eeca-5e70-44f2-9e76-d05b4e42506e None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:08.996780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023eeca-5e70-44f2-9e76-d05b4e42506e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:08.997208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023eeca-5e70-44f2-9e76-d05b4e42506e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:08.998739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023eeca-5e70-44f2-9e76-d05b4e42506e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:09.004430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a5f14-9cb0-4ca6-ba74-86aeb8a3ccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:09.005089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a5f14-9cb0-4ca6-ba74-86aeb8a3ccd0 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.005377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a5f14-9cb0-4ca6-ba74-86aeb8a3ccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.005651 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a5f14-9cb0-4ca6-ba74-86aeb8a3ccd0 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.006359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a5f14-9cb0-4ca6-ba74-86aeb8a3ccd0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:09.006664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a5f14-9cb0-4ca6-ba74-86aeb8a3ccd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:09.008069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a5f14-9cb0-4ca6-ba74-86aeb8a3ccd0 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:09.010340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 435/855] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:09.011173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023eeca-5e70-44f2-9e76-d05b4e42506e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:09.013142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 421/856] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:40:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:09.014213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb892-2c55-499a-9ec8-138220fb0158 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.014501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb892-2c55-499a-9ec8-138220fb0158 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.014781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fb892-2c55-499a-9ec8-138220fb0158 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.019086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 422/857] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:09.019086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fb892-2c55-499a-9ec8-138220fb0158 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:09.113895 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023eeca-5e70-44f2-9e76-d05b4e42506e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:09.123112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fb892-2c55-499a-9ec8-138220fb0158 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:09.146558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d82b07-5a5f-4185-b7e5-7be708f27342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:09.147306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d82b07-5a5f-4185-b7e5-7be708f27342 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.147584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d82b07-5a5f-4185-b7e5-7be708f27342 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.147858 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d82b07-5a5f-4185-b7e5-7be708f27342 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.148688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d82b07-5a5f-4185-b7e5-7be708f27342 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:09.149000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d82b07-5a5f-4185-b7e5-7be708f27342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:09.150419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d82b07-5a5f-4185-b7e5-7be708f27342 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:09.156918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6ba8d-c0b7-4b53-81fd-71eb5882b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:09.157573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6ba8d-c0b7-4b53-81fd-71eb5882b480 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.157860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6ba8d-c0b7-4b53-81fd-71eb5882b480 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.158141 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6ba8d-c0b7-4b53-81fd-71eb5882b480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.158985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6ba8d-c0b7-4b53-81fd-71eb5882b480 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=d8ea258578544e5c8f05b751d31e0f34) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:09.159316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6ba8d-c0b7-4b53-81fd-71eb5882b480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:09.160620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:09.160730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6ba8d-c0b7-4b53-81fd-71eb5882b480 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:09.166482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 423/858] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:09 2022] GET /identity/v3/role_assignments?user.id=d8ea258578544e5c8f05b751d31e0f34&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=3951cc86a51d416fafc5676d456e79ce => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:09.167694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f42f5-0283-4535-920a-3f682497ef9e None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.167983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f42f5-0283-4535-920a-3f682497ef9e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.169074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f42f5-0283-4535-920a-3f682497ef9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.174654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 436/859] 10.222.0.42 () {56 vars in 1149 bytes} [Fri May 27 13:40:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:09.174654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d82b07-5a5f-4185-b7e5-7be708f27342 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:09.199021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3c1f42f5-0283-4535-920a-3f682497ef9e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:09.200566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3c1f42f5-0283-4535-920a-3f682497ef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:09.221046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:09.283278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 424/860] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:09.283278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f42f5-0283-4535-920a-3f682497ef9e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:09.287117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d82b07-5a5f-4185-b7e5-7be708f27342 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:09.327705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa9921-3fbb-4bdf-b64b-9b694a290849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:09.328384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa9921-3fbb-4bdf-b64b-9b694a290849 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.328669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa9921-3fbb-4bdf-b64b-9b694a290849 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.328946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa9921-3fbb-4bdf-b64b-9b694a290849 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.329681 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa9921-3fbb-4bdf-b64b-9b694a290849 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:09.329983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa9921-3fbb-4bdf-b64b-9b694a290849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:09.331417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa9921-3fbb-4bdf-b64b-9b694a290849 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:09.336609 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 437/861] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:40:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:09.337464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa9921-3fbb-4bdf-b64b-9b694a290849 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:09.435938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f42f5-0283-4535-920a-3f682497ef9e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:09.436627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:09.485217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa9921-3fbb-4bdf-b64b-9b694a290849 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:09.488896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161794cb-d329-4a79-9b48-2710195d22da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:09.489573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161794cb-d329-4a79-9b48-2710195d22da None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.489866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161794cb-d329-4a79-9b48-2710195d22da None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.490163 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161794cb-d329-4a79-9b48-2710195d22da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.517548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:09.528723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280ca2f-a60a-4d9c-bdbd-09cd294b22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:09.530086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280ca2f-a60a-4d9c-bdbd-09cd294b22aa None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.530371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280ca2f-a60a-4d9c-bdbd-09cd294b22aa None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.530650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280ca2f-a60a-4d9c-bdbd-09cd294b22aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.532337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280ca2f-a60a-4d9c-bdbd-09cd294b22aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:09.533827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280ca2f-a60a-4d9c-bdbd-09cd294b22aa None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-5280ca2f-a60a-4d9c-bdbd-09cd294b22aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:09.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:09.553300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:09.554489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 438/862] 10.222.0.42 () {56 vars in 1132 bytes} [Fri May 27 13:40:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:09.559693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280ca2f-a60a-4d9c-bdbd-09cd294b22aa None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:09.572130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161794cb-d329-4a79-9b48-2710195d22da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:09.573590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161794cb-d329-4a79-9b48-2710195d22da None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:09.692323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280ca2f-a60a-4d9c-bdbd-09cd294b22aa None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:09.704885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 425/863] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:40:09.706205 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161794cb-d329-4a79-9b48-2710195d22da None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:09.726739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:09.739817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d3bef-7e44-4ef4-b62c-27a3f4fd66b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:09.744703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3bef-7e44-4ef4-b62c-27a3f4fd66b9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.744703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3bef-7e44-4ef4-b62c-27a3f4fd66b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.744703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d3bef-7e44-4ef4-b62c-27a3f4fd66b9 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.744703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d3bef-7e44-4ef4-b62c-27a3f4fd66b9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:09.744703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d3bef-7e44-4ef4-b62c-27a3f4fd66b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:09.745623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d3bef-7e44-4ef4-b62c-27a3f4fd66b9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:09.752458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 439/864] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:09.759136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d3bef-7e44-4ef4-b62c-27a3f4fd66b9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:09.770177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:09.823340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161794cb-d329-4a79-9b48-2710195d22da None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:09.867095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb755f43-17d1-4fe1-a223-c6f02659daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:09.867895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb755f43-17d1-4fe1-a223-c6f02659daf5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.870249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb755f43-17d1-4fe1-a223-c6f02659daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.870249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb755f43-17d1-4fe1-a223-c6f02659daf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.879845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb755f43-17d1-4fe1-a223-c6f02659daf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:09.881344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb755f43-17d1-4fe1-a223-c6f02659daf5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-eb755f43-17d1-4fe1-a223-c6f02659daf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:09.900048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:09.901177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:09.902168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:09.902168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:09.902168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:09.902168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:09.905961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d3bef-7e44-4ef4-b62c-27a3f4fd66b9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:09.906445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 426/865] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:09.907706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb755f43-17d1-4fe1-a223-c6f02659daf5 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:09.944377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0eb60-c5bc-483c-a5a2-8ecfbcefc33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:09.945161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0eb60-c5bc-483c-a5a2-8ecfbcefc33b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:09.945518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0eb60-c5bc-483c-a5a2-8ecfbcefc33b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:09.945862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0eb60-c5bc-483c-a5a2-8ecfbcefc33b None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:09.946646 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0eb60-c5bc-483c-a5a2-8ecfbcefc33b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:09.947050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0eb60-c5bc-483c-a5a2-8ecfbcefc33b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:09.948491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0eb60-c5bc-483c-a5a2-8ecfbcefc33b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:09.954321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 440/866] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:10.027113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb755f43-17d1-4fe1-a223-c6f02659daf5 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:10.030646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:10.068624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1e2e7-ad60-4454-ba60-75a635c3c296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:10.069364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1e2e7-ad60-4454-ba60-75a635c3c296 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:10.069650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1e2e7-ad60-4454-ba60-75a635c3c296 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:10.069930 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1e2e7-ad60-4454-ba60-75a635c3c296 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:10.070725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1e2e7-ad60-4454-ba60-75a635c3c296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:10.071071 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1e2e7-ad60-4454-ba60-75a635c3c296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:10.072505 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1e2e7-ad60-4454-ba60-75a635c3c296 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:10.086450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 427/867] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:10.096155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0eb60-c5bc-483c-a5a2-8ecfbcefc33b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:10.161414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:10.212258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0eb60-c5bc-483c-a5a2-8ecfbcefc33b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:10.250621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b5ab9-0573-49f8-a585-1a90c7ed81eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:10.251443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5ab9-0573-49f8-a585-1a90c7ed81eb None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:10.251724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5ab9-0573-49f8-a585-1a90c7ed81eb None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:10.251994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5ab9-0573-49f8-a585-1a90c7ed81eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:10.258954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b5ab9-0573-49f8-a585-1a90c7ed81eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:10.260415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b5ab9-0573-49f8-a585-1a90c7ed81eb None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-649b5ab9-0573-49f8-a585-1a90c7ed81eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:10.275965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:10.276865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:10.278119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:10.278119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:10.278119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:10.278119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:10.278119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:10.278119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:10.278119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:10.278119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:10.281942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 441/868] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:10.284057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1e2e7-ad60-4454-ba60-75a635c3c296 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:10.392539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1e2e7-ad60-4454-ba60-75a635c3c296 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:10.432592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670865f8-aafb-4de4-9e60-c9e31662b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:10.433260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670865f8-aafb-4de4-9e60-c9e31662b914 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:10.433545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670865f8-aafb-4de4-9e60-c9e31662b914 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:10.434397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670865f8-aafb-4de4-9e60-c9e31662b914 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:10.435403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670865f8-aafb-4de4-9e60-c9e31662b914 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:10.435715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670865f8-aafb-4de4-9e60-c9e31662b914 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:10.437157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670865f8-aafb-4de4-9e60-c9e31662b914 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:10.450297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 428/869] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:10.456277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b5ab9-0573-49f8-a585-1a90c7ed81eb None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:10.571585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b5ab9-0573-49f8-a585-1a90c7ed81eb None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:10.597632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:10.616943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d50f3-405d-42ce-9bb3-d961bdb23175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:10.617927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d50f3-405d-42ce-9bb3-d961bdb23175 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:10.618396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d50f3-405d-42ce-9bb3-d961bdb23175 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:10.618862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d50f3-405d-42ce-9bb3-d961bdb23175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:10.619919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d50f3-405d-42ce-9bb3-d961bdb23175 None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=604a6139cec24af6a40c5eee3f197b7b) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:10.620461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d50f3-405d-42ce-9bb3-d961bdb23175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:10.622254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d50f3-405d-42ce-9bb3-d961bdb23175 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:10.629332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 442/870] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:10 2022] GET /identity/v3/role_assignments?user.id=604a6139cec24af6a40c5eee3f197b7b&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:11.526105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45854d-63de-4c79-b870-8dccc816e99e None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:11.526648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45854d-63de-4c79-b870-8dccc816e99e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:11.526941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45854d-63de-4c79-b870-8dccc816e99e None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:11.529019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 429/871] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:11.534550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1cb1b-b808-421f-aae4-c5588895f50c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:11.535002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1cb1b-b808-421f-aae4-c5588895f50c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:11.535201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd1cb1b-b808-421f-aae4-c5588895f50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:11.553067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7bd1cb1b-b808-421f-aae4-c5588895f50c None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:11.554258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7bd1cb1b-b808-421f-aae4-c5588895f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:11.625932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 443/872] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:11.649183 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45854d-63de-4c79-b870-8dccc816e99e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:11.653335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9b3c4-2d27-4085-a1ca-8cda7b4dbb7b None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:11.653626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9b3c4-2d27-4085-a1ca-8cda7b4dbb7b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:11.653901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9b3c4-2d27-4085-a1ca-8cda7b4dbb7b None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:11.655931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 444/873] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:11.661044 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95dc32-5291-45e9-aa79-6591dd3c2303 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:11.661198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95dc32-5291-45e9-aa79-6591dd3c2303 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:11.661404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95dc32-5291-45e9-aa79-6591dd3c2303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:11.679853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-4e95dc32-5291-45e9-aa79-6591dd3c2303 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:11.681038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4e95dc32-5291-45e9-aa79-6591dd3c2303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:11.683228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:11.763229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 445/874] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:11.781160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95dc32-5291-45e9-aa79-6591dd3c2303 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:11.785658 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45854d-63de-4c79-b870-8dccc816e99e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:11.824905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:11.835441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb576f-59c8-4254-a203-22781c85917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:11.843674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb576f-59c8-4254-a203-22781c85917d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:11.843674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb576f-59c8-4254-a203-22781c85917d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:11.843674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb576f-59c8-4254-a203-22781c85917d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:11.843674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb576f-59c8-4254-a203-22781c85917d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:11.843674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb576f-59c8-4254-a203-22781c85917d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-befb576f-59c8-4254-a203-22781c85917d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:11.857136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:11.858153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:11.859020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:11.863050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 430/875] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:11.864608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb576f-59c8-4254-a203-22781c85917d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:11.899300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95dc32-5291-45e9-aa79-6591dd3c2303 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:11.936358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d5d41-1424-4b60-9eee-0db5d9e51cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:11.937388 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d5d41-1424-4b60-9eee-0db5d9e51cb5 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:11.937875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d5d41-1424-4b60-9eee-0db5d9e51cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:11.938378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d5d41-1424-4b60-9eee-0db5d9e51cb5 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:11.939354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d5d41-1424-4b60-9eee-0db5d9e51cb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:11.940925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d5d41-1424-4b60-9eee-0db5d9e51cb5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:11.977151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:11.989070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb576f-59c8-4254-a203-22781c85917d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:12.027266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 446/876] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:40:11 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:40:12.037024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ea4eb-30fc-4032-8cb6-705a3a2afad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:12.037631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea4eb-30fc-4032-8cb6-705a3a2afad1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:12.037919 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea4eb-30fc-4032-8cb6-705a3a2afad1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:12.038202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ea4eb-30fc-4032-8cb6-705a3a2afad1 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:12.038931 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ea4eb-30fc-4032-8cb6-705a3a2afad1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:12.039271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ea4eb-30fc-4032-8cb6-705a3a2afad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:12.040801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ea4eb-30fc-4032-8cb6-705a3a2afad1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:12.046918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 431/877] 10.222.0.42 () {56 vars in 1122 bytes} [Fri May 27 13:40:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:12.052915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d5d41-1424-4b60-9eee-0db5d9e51cb5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:12.169222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:12.173907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d5d41-1424-4b60-9eee-0db5d9e51cb5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:12.212074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a8682-dca1-40f5-9fcc-de8946d6e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:12.212813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a8682-dca1-40f5-9fcc-de8946d6e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:12.213106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a8682-dca1-40f5-9fcc-de8946d6e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:12.213388 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a8682-dca1-40f5-9fcc-de8946d6e6d2 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:12.214109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a8682-dca1-40f5-9fcc-de8946d6e6d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:12.214420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a8682-dca1-40f5-9fcc-de8946d6e6d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:12.216473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a8682-dca1-40f5-9fcc-de8946d6e6d2 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:12.222363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 447/878] 10.222.0.42 () {56 vars in 1122 bytes} [Fri May 27 13:40:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:12.311439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff81e4-901e-4cb4-98b3-a7278c5d6503 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:12.311635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff81e4-901e-4cb4-98b3-a7278c5d6503 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:12.311911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff81e4-901e-4cb4-98b3-a7278c5d6503 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:12.313653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 432/879] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:12.319978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa956-706a-498f-a47b-e46eb30b5121 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:12.320262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa956-706a-498f-a47b-e46eb30b5121 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:12.320542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aa956-706a-498f-a47b-e46eb30b5121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:12.339953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b95aa956-706a-498f-a47b-e46eb30b5121 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:12.342034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b95aa956-706a-498f-a47b-e46eb30b5121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:12.421462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 448/880] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:12.444974 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff81e4-901e-4cb4-98b3-a7278c5d6503 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:12.556817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff81e4-901e-4cb4-98b3-a7278c5d6503 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:12.593567 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533da6b6-35d7-4ee5-9054-7e65a92b4b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:12.594161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da6b6-35d7-4ee5-9054-7e65a92b4b1c None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:12.594446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da6b6-35d7-4ee5-9054-7e65a92b4b1c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:12.594721 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da6b6-35d7-4ee5-9054-7e65a92b4b1c None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:12.595495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533da6b6-35d7-4ee5-9054-7e65a92b4b1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:12.596878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533da6b6-35d7-4ee5-9054-7e65a92b4b1c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:12.708718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 433/881] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:40:12 2022] POST /identity/v3/services => generated 269 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:40:12.957694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2cc66-db2a-4a11-8bf7-e129e830b6f4 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:12.958200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2cc66-db2a-4a11-8bf7-e129e830b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:12.958200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2cc66-db2a-4a11-8bf7-e129e830b6f4 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:12.959813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 449/882] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:12.965365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1f95-fed8-4ee8-90f3-f13bee9db629 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:12.965664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1f95-fed8-4ee8-90f3-f13bee9db629 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:12.965953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1f95-fed8-4ee8-90f3-f13bee9db629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:12.983315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-9f6b1f95-fed8-4ee8-90f3-f13bee9db629 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:12.984651 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9f6b1f95-fed8-4ee8-90f3-f13bee9db629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:12.986812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:13.063694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 434/883] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:13.087525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2cc66-db2a-4a11-8bf7-e129e830b6f4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:13.187564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:13.197259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2cc66-db2a-4a11-8bf7-e129e830b6f4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:13.233463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25866-24d7-4436-ad22-9dc486f49f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:13.234883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25866-24d7-4436-ad22-9dc486f49f80 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:13.234883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25866-24d7-4436-ad22-9dc486f49f80 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:13.235079 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25866-24d7-4436-ad22-9dc486f49f80 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:13.251322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de25866-24d7-4436-ad22-9dc486f49f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-4de25866-24d7-4436-ad22-9dc486f49f80 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:13.259622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:13.260578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:13.261582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 450/884] 10.222.0.42 () {56 vars in 1120 bytes} [Fri May 27 13:40:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:13.267554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b1f95-fed8-4ee8-90f3-f13bee9db629 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:13.377614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b1f95-fed8-4ee8-90f3-f13bee9db629 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:13.416368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b182b7-8443-4a80-8e03-ad5bdb2b8cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:13.417427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b182b7-8443-4a80-8e03-ad5bdb2b8cf2 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:13.417932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b182b7-8443-4a80-8e03-ad5bdb2b8cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:13.419017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b182b7-8443-4a80-8e03-ad5bdb2b8cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:13.420046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b182b7-8443-4a80-8e03-ad5bdb2b8cf2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:13.420548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b182b7-8443-4a80-8e03-ad5bdb2b8cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:13.422110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b182b7-8443-4a80-8e03-ad5bdb2b8cf2 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:13.423810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:13.431545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 435/885] 10.222.0.42 () {56 vars in 1115 bytes} [Fri May 27 13:40:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:13.440304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25866-24d7-4436-ad22-9dc486f49f80 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:13.547782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25866-24d7-4436-ad22-9dc486f49f80 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:13.583225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bf473-f92a-4bc7-8497-8b7d6f81f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:13.584017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bf473-f92a-4bc7-8497-8b7d6f81f181 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:13.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bf473-f92a-4bc7-8497-8b7d6f81f181 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:13.584572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bf473-f92a-4bc7-8497-8b7d6f81f181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:13.595929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bf473-f92a-4bc7-8497-8b7d6f81f181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:13.597384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bf473-f92a-4bc7-8497-8b7d6f81f181 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-a54bf473-f92a-4bc7-8497-8b7d6f81f181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:13.614362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:13.615297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:13.616176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:13.616176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:13.616176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:13.616176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:13.616176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 451/886] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:13.624256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b182b7-8443-4a80-8e03-ad5bdb2b8cf2 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:13.742895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b182b7-8443-4a80-8e03-ad5bdb2b8cf2 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:13.777307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6110e4-aa56-4def-b6ba-77b77aaae21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:13.778588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6110e4-aa56-4def-b6ba-77b77aaae21a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:13.778872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6110e4-aa56-4def-b6ba-77b77aaae21a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:13.779175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6110e4-aa56-4def-b6ba-77b77aaae21a None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:13.779896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6110e4-aa56-4def-b6ba-77b77aaae21a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:13.780200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6110e4-aa56-4def-b6ba-77b77aaae21a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:13.781573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6110e4-aa56-4def-b6ba-77b77aaae21a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:13.794163 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 436/887] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:13.800143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bf473-f92a-4bc7-8497-8b7d6f81f181 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:13.804323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:13.904790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bf473-f92a-4bc7-8497-8b7d6f81f181 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:13.946788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04303c-4110-4657-aa38-a5bec20b5fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:13.947642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04303c-4110-4657-aa38-a5bec20b5fd9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:13.947925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04303c-4110-4657-aa38-a5bec20b5fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:13.948201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04303c-4110-4657-aa38-a5bec20b5fd9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:13.957122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04303c-4110-4657-aa38-a5bec20b5fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:13.958565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04303c-4110-4657-aa38-a5bec20b5fd9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-4f04303c-4110-4657-aa38-a5bec20b5fd9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:13.973518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:13.974503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:13.975470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 452/888] 10.222.0.42 () {56 vars in 1117 bytes} [Fri May 27 13:40:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:13.983022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6110e4-aa56-4def-b6ba-77b77aaae21a None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:14.045460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:14.091934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6110e4-aa56-4def-b6ba-77b77aaae21a None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:14.133148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae5f45-d31e-4d13-a2e3-29c78c146016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:14.133833 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae5f45-d31e-4d13-a2e3-29c78c146016 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:14.134120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae5f45-d31e-4d13-a2e3-29c78c146016 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:14.134400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae5f45-d31e-4d13-a2e3-29c78c146016 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:14.135296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae5f45-d31e-4d13-a2e3-29c78c146016 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:14.135622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae5f45-d31e-4d13-a2e3-29c78c146016 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:14.137504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae5f45-d31e-4d13-a2e3-29c78c146016 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:14.156039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 437/889] 10.222.0.42 () {56 vars in 1149 bytes} [Fri May 27 13:40:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:14.164046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04303c-4110-4657-aa38-a5bec20b5fd9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:14.230341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:14.270504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04303c-4110-4657-aa38-a5bec20b5fd9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:14.310012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5951e7a-a4d5-49a5-9528-74b2b4876cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:14.310677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5951e7a-a4d5-49a5-9528-74b2b4876cb3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:14.310961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5951e7a-a4d5-49a5-9528-74b2b4876cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:14.311268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5951e7a-a4d5-49a5-9528-74b2b4876cb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:14.387037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5951e7a-a4d5-49a5-9528-74b2b4876cb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:14.388690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5951e7a-a4d5-49a5-9528-74b2b4876cb3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:14.459338 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:14.484873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049185c-5e24-439b-953e-6ccc469cc09e None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:14.485557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049185c-5e24-439b-953e-6ccc469cc09e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:14.486045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049185c-5e24-439b-953e-6ccc469cc09e None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:14.487677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 438/890] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:14.491184 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 453/891] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:14 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:40:14.497329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049185c-5e24-439b-953e-6ccc469cc09e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:14.498016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77832b-6919-493a-a537-64f95906e113 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:14.498305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77832b-6919-493a-a537-64f95906e113 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:14.498625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77832b-6919-493a-a537-64f95906e113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:14.515164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3f77832b-6919-493a-a537-64f95906e113 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:14.516352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3f77832b-6919-493a-a537-64f95906e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:14.587234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 454/892] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:14.588962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee638ed0-9987-46d5-bc96-6afb6fecf63d None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:14.589477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee638ed0-9987-46d5-bc96-6afb6fecf63d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:14.589956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee638ed0-9987-46d5-bc96-6afb6fecf63d None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:14.596289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 455/893] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:14.597696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d44e2-5a4b-45fa-b326-e053cc069a9d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:14.598218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d44e2-5a4b-45fa-b326-e053cc069a9d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:14.598703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d44e2-5a4b-45fa-b326-e053cc069a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:14.616430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-431d44e2-5a4b-45fa-b326-e053cc069a9d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:14.617002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049185c-5e24-439b-953e-6ccc469cc09e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:14.617611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-431d44e2-5a4b-45fa-b326-e053cc069a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:14.634116 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:14.657341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b177fa-c002-4007-b453-7cd904177cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:14.658202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b177fa-c002-4007-b453-7cd904177cdd None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:14.658491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b177fa-c002-4007-b453-7cd904177cdd None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:14.658764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b177fa-c002-4007-b453-7cd904177cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:14.672870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b177fa-c002-4007-b453-7cd904177cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:14.674346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b177fa-c002-4007-b453-7cd904177cdd None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-d7b177fa-c002-4007-b453-7cd904177cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:14.692653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:14.693613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:14.703550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:14.703550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:14.703550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:14.703550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:14.703792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 456/895] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:14.703866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 439/895] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:14.703933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d44e2-5a4b-45fa-b326-e053cc069a9d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:14.704001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b177fa-c002-4007-b453-7cd904177cdd None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:14.732746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:14.814302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d44e2-5a4b-45fa-b326-e053cc069a9d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:14.814668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b177fa-c002-4007-b453-7cd904177cdd None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:14.849545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13d1cd-daca-45b1-8be2-e265636c78c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:14.849775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15411cb9-e775-4d1f-bcd5-1fa40b693908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:14.850210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13d1cd-daca-45b1-8be2-e265636c78c9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:14.850443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15411cb9-e775-4d1f-bcd5-1fa40b693908 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:14.850545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13d1cd-daca-45b1-8be2-e265636c78c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:14.850728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15411cb9-e775-4d1f-bcd5-1fa40b693908 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:14.850834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13d1cd-daca-45b1-8be2-e265636c78c9 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:14.851028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15411cb9-e775-4d1f-bcd5-1fa40b693908 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:14.851480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13d1cd-daca-45b1-8be2-e265636c78c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:14.851682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15411cb9-e775-4d1f-bcd5-1fa40b693908 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:14.851790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13d1cd-daca-45b1-8be2-e265636c78c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:14.853048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15411cb9-e775-4d1f-bcd5-1fa40b693908 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:14.853419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13d1cd-daca-45b1-8be2-e265636c78c9 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-15411cb9-e775-4d1f-bcd5-1fa40b693908 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:14.865732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:14.866751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 13:40:14.867655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:14.868393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 440/896] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:14.868393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13d1cd-daca-45b1-8be2-e265636c78c9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:14.876550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 457/897] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:40:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:14.876550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15411cb9-e775-4d1f-bcd5-1fa40b693908 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:14.901277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:14.975499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:14.983612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13d1cd-daca-45b1-8be2-e265636c78c9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:14.991291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15411cb9-e775-4d1f-bcd5-1fa40b693908 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:15.020550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52be4e6-086a-432b-8959-91a35d2ddc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.021217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52be4e6-086a-432b-8959-91a35d2ddc70 None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.021500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52be4e6-086a-432b-8959-91a35d2ddc70 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.021767 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52be4e6-086a-432b-8959-91a35d2ddc70 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.022482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52be4e6-086a-432b-8959-91a35d2ddc70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.023883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52be4e6-086a-432b-8959-91a35d2ddc70 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.027108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758188-51fd-4629-a05c-3ced4358b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.028106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758188-51fd-4629-a05c-3ced4358b10d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.028398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758188-51fd-4629-a05c-3ced4358b10d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.028673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc758188-51fd-4629-a05c-3ced4358b10d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.035717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc758188-51fd-4629-a05c-3ced4358b10d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.037148 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc758188-51fd-4629-a05c-3ced4358b10d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-bc758188-51fd-4629-a05c-3ced4358b10d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:15.051704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:15.052761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:15.053947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:15.053947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:15.053947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:15.053947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:15.053947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:15.053947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:15.053947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:15.053947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:15.055284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 458/898] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:15.056066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758188-51fd-4629-a05c-3ced4358b10d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:15.101140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 441/899] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:40:14 2022] POST /identity/v3/services => generated 241 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:40:15.102110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52be4e6-086a-432b-8959-91a35d2ddc70 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:15.180553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc758188-51fd-4629-a05c-3ced4358b10d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:15.203032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:15.226793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25347923-b1f1-4de9-9702-38ae4b48a0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.227054 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52be4e6-086a-432b-8959-91a35d2ddc70 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:15.227414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25347923-b1f1-4de9-9702-38ae4b48a0a4 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.227706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25347923-b1f1-4de9-9702-38ae4b48a0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.227985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25347923-b1f1-4de9-9702-38ae4b48a0a4 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.228703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25347923-b1f1-4de9-9702-38ae4b48a0a4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:15.229021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25347923-b1f1-4de9-9702-38ae4b48a0a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.230518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25347923-b1f1-4de9-9702-38ae4b48a0a4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.236875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 459/900] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:40:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:15.238345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd20ff2-0e84-471c-9e42-34d897ff4d03 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.238632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd20ff2-0e84-471c-9e42-34d897ff4d03 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.238908 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd20ff2-0e84-471c-9e42-34d897ff4d03 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.240476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 460/901] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:15.245624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd20ff2-0e84-471c-9e42-34d897ff4d03 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:15.258562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:15.278672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23555509-a01a-462c-b693-ec22f752311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.279535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23555509-a01a-462c-b693-ec22f752311e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.279822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23555509-a01a-462c-b693-ec22f752311e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.280100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23555509-a01a-462c-b693-ec22f752311e None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.280903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23555509-a01a-462c-b693-ec22f752311e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:15.281219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23555509-a01a-462c-b693-ec22f752311e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.282751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23555509-a01a-462c-b693-ec22f752311e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.297894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 442/902] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:15.299264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee504a3-9c86-4c26-a473-2854b7caa023 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.299413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee504a3-9c86-4c26-a473-2854b7caa023 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.299989 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee504a3-9c86-4c26-a473-2854b7caa023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.323037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8ee504a3-9c86-4c26-a473-2854b7caa023 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:15.324532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8ee504a3-9c86-4c26-a473-2854b7caa023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:15.367320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd20ff2-0e84-471c-9e42-34d897ff4d03 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:15.395577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 443/903] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:15.396418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee504a3-9c86-4c26-a473-2854b7caa023 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:15.413528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a36b0d-8d83-4046-a1a2-555d75093b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.414561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36b0d-8d83-4046-a1a2-555d75093b32 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.415082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36b0d-8d83-4046-a1a2-555d75093b32 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.415684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a36b0d-8d83-4046-a1a2-555d75093b32 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.416758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a36b0d-8d83-4046-a1a2-555d75093b32 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:15.417270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a36b0d-8d83-4046-a1a2-555d75093b32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.419415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a36b0d-8d83-4046-a1a2-555d75093b32 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.425370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 461/904] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:40:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:15.426352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a36b0d-8d83-4046-a1a2-555d75093b32 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:15.480016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:15.504390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:15.509708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee504a3-9c86-4c26-a473-2854b7caa023 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:15.536613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a36b0d-8d83-4046-a1a2-555d75093b32 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:15.545802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2579-362e-4c8d-8dde-95800bb9e1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.546466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2579-362e-4c8d-8dde-95800bb9e1e9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.546747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2579-362e-4c8d-8dde-95800bb9e1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.547072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2579-362e-4c8d-8dde-95800bb9e1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.548023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c2579-362e-4c8d-8dde-95800bb9e1e9 None admin] RBAC: Adding query filter params (role.id=d88071d05f2e438dbbe25f0bcd08b9a4, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=604a6139cec24af6a40c5eee3f197b7b) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:15.548345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c2579-362e-4c8d-8dde-95800bb9e1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.550041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c2579-362e-4c8d-8dde-95800bb9e1e9 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.555832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 444/905] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:15 2022] GET /identity/v3/role_assignments?user.id=604a6139cec24af6a40c5eee3f197b7b&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=d88071d05f2e438dbbe25f0bcd08b9a4 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:15.556428 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2579-362e-4c8d-8dde-95800bb9e1e9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:15.590299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2630de-ef24-4e8d-9466-094650ad81cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.591891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2630de-ef24-4e8d-9466-094650ad81cc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.592564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2630de-ef24-4e8d-9466-094650ad81cc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.593055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2630de-ef24-4e8d-9466-094650ad81cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.594610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2630de-ef24-4e8d-9466-094650ad81cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.596533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2630de-ef24-4e8d-9466-094650ad81cc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ad2630de-ef24-4e8d-9466-094650ad81cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:15.614013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:15.615075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 13:40:15.615901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:15.619411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 462/906] 10.222.0.42 () {56 vars in 1132 bytes} [Fri May 27 13:40:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:15.622728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2630de-ef24-4e8d-9466-094650ad81cc None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:15.705341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2579-362e-4c8d-8dde-95800bb9e1e9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:15.744146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2630de-ef24-4e8d-9466-094650ad81cc None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:15.754958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3578186-64a4-4c57-aba1-8e95770fbc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.755985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3578186-64a4-4c57-aba1-8e95770fbc1d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.756767 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3578186-64a4-4c57-aba1-8e95770fbc1d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.757548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3578186-64a4-4c57-aba1-8e95770fbc1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.758557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3578186-64a4-4c57-aba1-8e95770fbc1d None admin] RBAC: Adding query filter params (interface=public, service_id=6fe40496fa5f4d2687593a5c1a717d5c, region_id=RegionOne) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:15.759271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3578186-64a4-4c57-aba1-8e95770fbc1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.761257 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3578186-64a4-4c57-aba1-8e95770fbc1d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.767972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:15.774995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 445/907] 10.222.0.42 () {56 vars in 1251 bytes} [Fri May 27 13:40:15 2022] GET /identity/v3/endpoints?service_id=6fe40496fa5f4d2687593a5c1a717d5c&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:15.778392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3578186-64a4-4c57-aba1-8e95770fbc1d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:15.789034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddfd08-2301-4042-b939-55cba5d82d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.789703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddfd08-2301-4042-b939-55cba5d82d66 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.789989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddfd08-2301-4042-b939-55cba5d82d66 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.790263 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ddfd08-2301-4042-b939-55cba5d82d66 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.791508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddfd08-2301-4042-b939-55cba5d82d66 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:15.791828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddfd08-2301-4042-b939-55cba5d82d66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.793745 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ddfd08-2301-4042-b939-55cba5d82d66 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.796096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:15.805284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 463/908] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:15.806619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddfd08-2301-4042-b939-55cba5d82d66 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:15.895333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3578186-64a4-4c57-aba1-8e95770fbc1d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:15.921473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ddfd08-2301-4042-b939-55cba5d82d66 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:15.931395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a76c4-f58c-4397-a16d-3a574db8ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.932068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a76c4-f58c-4397-a16d-3a574db8ee6d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.932354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a76c4-f58c-4397-a16d-3a574db8ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.932635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a76c4-f58c-4397-a16d-3a574db8ee6d None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.933327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a76c4-f58c-4397-a16d-3a574db8ee6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.935458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a76c4-f58c-4397-a16d-3a574db8ee6d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.946842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 446/909] 10.222.0.42 () {56 vars in 1087 bytes} [Fri May 27 13:40:15 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 13:40:15.970742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff2ed8-36fe-49ce-ad5d-f266e949c3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:15.971483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff2ed8-36fe-49ce-ad5d-f266e949c3db None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:15.971755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff2ed8-36fe-49ce-ad5d-f266e949c3db None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:15.972034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff2ed8-36fe-49ce-ad5d-f266e949c3db None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:15.972760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff2ed8-36fe-49ce-ad5d-f266e949c3db None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:15.973072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff2ed8-36fe-49ce-ad5d-f266e949c3db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:15.974465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff2ed8-36fe-49ce-ad5d-f266e949c3db None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:15.980757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 464/910] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:15.987582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a76c4-f58c-4397-a16d-3a574db8ee6d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:16.060419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:16.102961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a76c4-f58c-4397-a16d-3a574db8ee6d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:16.141684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee9aa5-b6cc-4a51-94e0-c7d8ac00a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:16.142375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee9aa5-b6cc-4a51-94e0-c7d8ac00a589 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:16.142657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee9aa5-b6cc-4a51-94e0-c7d8ac00a589 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:16.142941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee9aa5-b6cc-4a51-94e0-c7d8ac00a589 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:16.143781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee9aa5-b6cc-4a51-94e0-c7d8ac00a589 None admin] RBAC: Adding query filter params (interface=public, service_id=d79c958cbb594714b96501f51338709f, region_id=RegionOne) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:16.144097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee9aa5-b6cc-4a51-94e0-c7d8ac00a589 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:16.146588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee9aa5-b6cc-4a51-94e0-c7d8ac00a589 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:16.151609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 447/911] 10.222.0.42 () {56 vars in 1251 bytes} [Fri May 27 13:40:15 2022] GET /identity/v3/endpoints?service_id=d79c958cbb594714b96501f51338709f&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:16.158348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff2ed8-36fe-49ce-ad5d-f266e949c3db None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:16.228993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:16.273733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff2ed8-36fe-49ce-ad5d-f266e949c3db None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:16.310866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425251d-1281-4ee7-bdd8-98df6ed9538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:16.312134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425251d-1281-4ee7-bdd8-98df6ed9538c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:16.312647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425251d-1281-4ee7-bdd8-98df6ed9538c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:16.313115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425251d-1281-4ee7-bdd8-98df6ed9538c None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:16.314012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425251d-1281-4ee7-bdd8-98df6ed9538c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:16.315612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425251d-1281-4ee7-bdd8-98df6ed9538c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:16.322516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 465/912] 10.222.0.42 () {56 vars in 1087 bytes} [Fri May 27 13:40:16 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 13:40:17.354817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba6f5-db55-4fdb-911d-c149cd9347b6 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:17.355367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba6f5-db55-4fdb-911d-c149cd9347b6 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:17.355444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ba6f5-db55-4fdb-911d-c149cd9347b6 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:17.357066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 448/913] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:17.362467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba6450-d83b-48de-b7aa-60416f3bbc97 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:17.362903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba6450-d83b-48de-b7aa-60416f3bbc97 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:17.363041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba6450-d83b-48de-b7aa-60416f3bbc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:17.381515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a7ba6450-d83b-48de-b7aa-60416f3bbc97 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:17.382692 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a7ba6450-d83b-48de-b7aa-60416f3bbc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:17.453423 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 466/914] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:17.476561 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba6f5-db55-4fdb-911d-c149cd9347b6 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:17.581565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ba6f5-db55-4fdb-911d-c149cd9347b6 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:17.608902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:17.616539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8aa7b-4ae8-4af2-9715-78d6dc818c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:17.617354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8aa7b-4ae8-4af2-9715-78d6dc818c46 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:17.617640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8aa7b-4ae8-4af2-9715-78d6dc818c46 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:17.617916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8aa7b-4ae8-4af2-9715-78d6dc818c46 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:17.618571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8aa7b-4ae8-4af2-9715-78d6dc818c46 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:17.620109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8aa7b-4ae8-4af2-9715-78d6dc818c46 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-1cc8aa7b-4ae8-4af2-9715-78d6dc818c46 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:17.633363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:17.634404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:17.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 449/915] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:17.644176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba6450-d83b-48de-b7aa-60416f3bbc97 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:17.708763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:17.750118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba6450-d83b-48de-b7aa-60416f3bbc97 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:17.785424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbf01c-1a8f-46d1-8f04-eeb0d1e42742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:17.786096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf01c-1a8f-46d1-8f04-eeb0d1e42742 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:17.786377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf01c-1a8f-46d1-8f04-eeb0d1e42742 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:17.786648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbf01c-1a8f-46d1-8f04-eeb0d1e42742 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:17.787374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbf01c-1a8f-46d1-8f04-eeb0d1e42742 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:17.787678 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbf01c-1a8f-46d1-8f04-eeb0d1e42742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:17.789043 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbf01c-1a8f-46d1-8f04-eeb0d1e42742 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:17.801636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 467/916] 10.222.0.42 () {56 vars in 1122 bytes} [Fri May 27 13:40:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:17.808914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8aa7b-4ae8-4af2-9715-78d6dc818c46 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:17.862857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd723b-7072-4438-bc01-726c3219a3a1 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:17.863192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd723b-7072-4438-bc01-726c3219a3a1 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:17.863359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd723b-7072-4438-bc01-726c3219a3a1 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:17.864721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 468/917] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:17.869884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b509404-4b7d-46b4-b25a-9d6af1af43e0 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:17.870168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b509404-4b7d-46b4-b25a-9d6af1af43e0 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:17.870439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b509404-4b7d-46b4-b25a-9d6af1af43e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:17.901333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-9b509404-4b7d-46b4-b25a-9d6af1af43e0 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:17.903686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9b509404-4b7d-46b4-b25a-9d6af1af43e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:17.965564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8aa7b-4ae8-4af2-9715-78d6dc818c46 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:18.015000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a01a2-5235-4acc-8ca3-a663c3788c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:18.015000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a01a2-5235-4acc-8ca3-a663c3788c49 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.015000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a01a2-5235-4acc-8ca3-a663c3788c49 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.015000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a01a2-5235-4acc-8ca3-a663c3788c49 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.015424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a01a2-5235-4acc-8ca3-a663c3788c49 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:18.015424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a01a2-5235-4acc-8ca3-a663c3788c49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:18.015424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a01a2-5235-4acc-8ca3-a663c3788c49 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:18.016371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 469/918] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:18.022621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 450/919] 10.222.0.42 () {56 vars in 1122 bytes} [Fri May 27 13:40:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:18.031295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b509404-4b7d-46b4-b25a-9d6af1af43e0 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:18.046102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a01a2-5235-4acc-8ca3-a663c3788c49 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:18.099436 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:18.153819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b509404-4b7d-46b4-b25a-9d6af1af43e0 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:18.172563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:18.221656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac7cea-3519-4902-a589-597addd64a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:18.222690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac7cea-3519-4902-a589-597addd64a7e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.230601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac7cea-3519-4902-a589-597addd64a7e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.232028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac7cea-3519-4902-a589-597addd64a7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.236530 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac7cea-3519-4902-a589-597addd64a7e None admin] RBAC: Adding query filter params (interface=public, service_id=8970010cda4641b38333c34b298f0732, region_id=RegionOne) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:18.237205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac7cea-3519-4902-a589-597addd64a7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:18.238483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a01a2-5235-4acc-8ca3-a663c3788c49 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:18.243451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac7cea-3519-4902-a589-597addd64a7e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:18.260905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 470/920] 10.222.0.42 () {56 vars in 1251 bytes} [Fri May 27 13:40:18 2022] GET /identity/v3/endpoints?service_id=8970010cda4641b38333c34b298f0732&interface=public®ion_id=RegionOne => generated 194 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:18.267516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac7cea-3519-4902-a589-597addd64a7e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:18.303117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed16e75-5e9d-45de-a2ee-dcb3cde6834e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:18.305079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16e75-5e9d-45de-a2ee-dcb3cde6834e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.305364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16e75-5e9d-45de-a2ee-dcb3cde6834e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.305640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16e75-5e9d-45de-a2ee-dcb3cde6834e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.332984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed16e75-5e9d-45de-a2ee-dcb3cde6834e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-5ed16e75-5e9d-45de-a2ee-dcb3cde6834e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:18.342926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:18.343883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:18.345037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 451/921] 10.222.0.42 () {56 vars in 1120 bytes} [Fri May 27 13:40:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:18.345856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db83f8-5948-4d1a-aa08-7d657800385f None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.346082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db83f8-5948-4d1a-aa08-7d657800385f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.346357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db83f8-5948-4d1a-aa08-7d657800385f None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.347869 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 452/922] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:18.352575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db83f8-5948-4d1a-aa08-7d657800385f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:18.413030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac7cea-3519-4902-a589-597addd64a7e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:18.431484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:18.448004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf87d5-a212-4c12-abb0-0f52e515bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:18.448672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf87d5-a212-4c12-abb0-0f52e515bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.448953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf87d5-a212-4c12-abb0-0f52e515bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.449253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf87d5-a212-4c12-abb0-0f52e515bdc7 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.450618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf87d5-a212-4c12-abb0-0f52e515bdc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:18.452019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf87d5-a212-4c12-abb0-0f52e515bdc7 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:18.467000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 471/923] 10.222.0.42 () {56 vars in 1087 bytes} [Fri May 27 13:40:18 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 13:40:18.467000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6c8f4-d88d-44fd-8e41-f3b61fcd7f6b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.467000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6c8f4-d88d-44fd-8e41-f3b61fcd7f6b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.467000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6c8f4-d88d-44fd-8e41-f3b61fcd7f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.478424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-94d6c8f4-d88d-44fd-8e41-f3b61fcd7f6b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:18.479758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-94d6c8f4-d88d-44fd-8e41-f3b61fcd7f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:18.497102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db83f8-5948-4d1a-aa08-7d657800385f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:18.522171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:18.543983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440de91-4b06-4806-afde-375335630ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:18.544841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440de91-4b06-4806-afde-375335630ddd None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.545127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440de91-4b06-4806-afde-375335630ddd None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.545716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440de91-4b06-4806-afde-375335630ddd None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.546512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440de91-4b06-4806-afde-375335630ddd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:18.548030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440de91-4b06-4806-afde-375335630ddd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:18.550175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440de91-4b06-4806-afde-375335630ddd None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:18.562302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 453/924] 10.222.0.42 () {56 vars in 1115 bytes} [Fri May 27 13:40:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:18.567855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440de91-4b06-4806-afde-375335630ddd None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:18.575516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 472/925] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:18.603829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6c8f4-d88d-44fd-8e41-f3b61fcd7f6b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:18.694172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440de91-4b06-4806-afde-375335630ddd None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:18.738569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028845b-e6ad-4de8-923f-ef41e68558dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:18.739419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028845b-e6ad-4de8-923f-ef41e68558dc None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.739694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028845b-e6ad-4de8-923f-ef41e68558dc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.739969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028845b-e6ad-4de8-923f-ef41e68558dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.744687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6c8f4-d88d-44fd-8e41-f3b61fcd7f6b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:18.750634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028845b-e6ad-4de8-923f-ef41e68558dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:18.752123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028845b-e6ad-4de8-923f-ef41e68558dc None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:18.758463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-2028845b-e6ad-4de8-923f-ef41e68558dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:18.771111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:18.772026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:18.772917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:18.772917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:18.772917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:18.772917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:18.772917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 454/926] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:18.774106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381d4c-df87-4179-a4c4-cd3c5161bfb9 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.774536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381d4c-df87-4179-a4c4-cd3c5161bfb9 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.774811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381d4c-df87-4179-a4c4-cd3c5161bfb9 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.780455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 455/927] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:18.780455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92381d4c-df87-4179-a4c4-cd3c5161bfb9 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:18.794925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20127e0d-d5a4-462e-a6c9-049acac6c758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:18.795769 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20127e0d-d5a4-462e-a6c9-049acac6c758 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.796053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20127e0d-d5a4-462e-a6c9-049acac6c758 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.796328 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20127e0d-d5a4-462e-a6c9-049acac6c758 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.796979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20127e0d-d5a4-462e-a6c9-049acac6c758 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:18.798343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20127e0d-d5a4-462e-a6c9-049acac6c758 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-20127e0d-d5a4-462e-a6c9-049acac6c758 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:18.810946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:18.812007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:18.812864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 473/928] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:40:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:18.814288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce9025-18e1-45e7-9290-5dc2e547982e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.814288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce9025-18e1-45e7-9290-5dc2e547982e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.814288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce9025-18e1-45e7-9290-5dc2e547982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.814907 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:18.831206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-60ce9025-18e1-45e7-9290-5dc2e547982e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:18.832384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-60ce9025-18e1-45e7-9290-5dc2e547982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:18.896442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92381d4c-df87-4179-a4c4-cd3c5161bfb9 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:18.910991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 474/929] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:18.910991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce9025-18e1-45e7-9290-5dc2e547982e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:18.946933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8024ea-b6ad-4afd-aa5c-3e36ca3329f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:18.947559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8024ea-b6ad-4afd-aa5c-3e36ca3329f9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:18.947842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8024ea-b6ad-4afd-aa5c-3e36ca3329f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:18.948117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8024ea-b6ad-4afd-aa5c-3e36ca3329f9 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:18.948958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8024ea-b6ad-4afd-aa5c-3e36ca3329f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:18.949270 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8024ea-b6ad-4afd-aa5c-3e36ca3329f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:18.951111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8024ea-b6ad-4afd-aa5c-3e36ca3329f9 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:18.963812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 456/930] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:18.969765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8024ea-b6ad-4afd-aa5c-3e36ca3329f9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:19.010197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce9025-18e1-45e7-9290-5dc2e547982e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:19.016631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:19.050953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cf7a7-3982-48f7-a1e5-f6a03f1394b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:19.051902 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf7a7-3982-48f7-a1e5-f6a03f1394b9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:19.052190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf7a7-3982-48f7-a1e5-f6a03f1394b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:19.052467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cf7a7-3982-48f7-a1e5-f6a03f1394b9 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:19.053178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cf7a7-3982-48f7-a1e5-f6a03f1394b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:19.053486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cf7a7-3982-48f7-a1e5-f6a03f1394b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:19.054867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cf7a7-3982-48f7-a1e5-f6a03f1394b9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:19.060517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 475/931] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:40:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:19.061310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cf7a7-3982-48f7-a1e5-f6a03f1394b9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:19.075743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:19.084843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8024ea-b6ad-4afd-aa5c-3e36ca3329f9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:19.124825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fd4a5-0732-4c00-be6a-ee14fd847f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:19.125963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fd4a5-0732-4c00-be6a-ee14fd847f4d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:19.126509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fd4a5-0732-4c00-be6a-ee14fd847f4d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:19.126790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fd4a5-0732-4c00-be6a-ee14fd847f4d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:19.127472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fd4a5-0732-4c00-be6a-ee14fd847f4d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:19.129000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fd4a5-0732-4c00-be6a-ee14fd847f4d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-e99fd4a5-0732-4c00-be6a-ee14fd847f4d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:19.145172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:19.146125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 13:40:19.147312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:19.148763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 457/932] 10.222.0.42 () {56 vars in 1132 bytes} [Fri May 27 13:40:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:19.149584 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fd4a5-0732-4c00-be6a-ee14fd847f4d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:19.169139 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cf7a7-3982-48f7-a1e5-f6a03f1394b9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:19.208596 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933028f-2688-4e9e-ab35-51049892a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:19.209414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933028f-2688-4e9e-ab35-51049892a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:19.209730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933028f-2688-4e9e-ab35-51049892a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:19.210061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933028f-2688-4e9e-ab35-51049892a5c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:19.217961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933028f-2688-4e9e-ab35-51049892a5c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:19.219446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933028f-2688-4e9e-ab35-51049892a5c1 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-4933028f-2688-4e9e-ab35-51049892a5c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:19.234717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:19.235777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:19.236723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:19.236723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:19.236723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:19.236723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:19.236723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:19.236723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:19.236723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:19.236723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:19.236723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:40:19.236723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:19.240708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 476/933] 10.222.0.42 () {56 vars in 1117 bytes} [Fri May 27 13:40:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:19.241338 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933028f-2688-4e9e-ab35-51049892a5c1 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:19.258541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fd4a5-0732-4c00-be6a-ee14fd847f4d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:19.273390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:19.294748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8bb3d-7eb7-4a06-a2b5-4b2ab792db13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:19.295463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8bb3d-7eb7-4a06-a2b5-4b2ab792db13 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:19.295751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8bb3d-7eb7-4a06-a2b5-4b2ab792db13 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:19.296031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8bb3d-7eb7-4a06-a2b5-4b2ab792db13 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:19.296747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8bb3d-7eb7-4a06-a2b5-4b2ab792db13 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:19.297056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8bb3d-7eb7-4a06-a2b5-4b2ab792db13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:19.298441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8bb3d-7eb7-4a06-a2b5-4b2ab792db13 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:19.303637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 458/934] 10.222.0.42 () {56 vars in 1114 bytes} [Fri May 27 13:40:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:19.304424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8bb3d-7eb7-4a06-a2b5-4b2ab792db13 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:19.326195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:19.359766 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933028f-2688-4e9e-ab35-51049892a5c1 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:19.397023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a079f82-d08e-4c0b-b039-9cf33dce79fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:19.397875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a079f82-d08e-4c0b-b039-9cf33dce79fc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:19.398174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a079f82-d08e-4c0b-b039-9cf33dce79fc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:19.398429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a079f82-d08e-4c0b-b039-9cf33dce79fc None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:19.399157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a079f82-d08e-4c0b-b039-9cf33dce79fc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:19.399462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a079f82-d08e-4c0b-b039-9cf33dce79fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:19.400822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a079f82-d08e-4c0b-b039-9cf33dce79fc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:19.406757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 477/935] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:19.407777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a079f82-d08e-4c0b-b039-9cf33dce79fc None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:19.417870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8bb3d-7eb7-4a06-a2b5-4b2ab792db13 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:19.454418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e9b9e-5e58-409c-b26e-36199156a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:19.455120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e9b9e-5e58-409c-b26e-36199156a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:19.455640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e9b9e-5e58-409c-b26e-36199156a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:19.455774 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e9b9e-5e58-409c-b26e-36199156a9c5 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:19.456503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e9b9e-5e58-409c-b26e-36199156a9c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:19.456814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e9b9e-5e58-409c-b26e-36199156a9c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:19.458251 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e9b9e-5e58-409c-b26e-36199156a9c5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:19.479949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 459/936] 10.222.0.42 () {56 vars in 1149 bytes} [Fri May 27 13:40:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:19.479949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e9b9e-5e58-409c-b26e-36199156a9c5 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:19.514125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:19.524078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a079f82-d08e-4c0b-b039-9cf33dce79fc None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:19.552282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:19.562732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eca4b-deae-4219-9862-28411d1e066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:19.563424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eca4b-deae-4219-9862-28411d1e066b None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:19.563716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eca4b-deae-4219-9862-28411d1e066b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:19.563993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eca4b-deae-4219-9862-28411d1e066b None admin] PATH_INFO: `/v3/endpoints` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:19.564728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eca4b-deae-4219-9862-28411d1e066b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:19.566091 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eca4b-deae-4219-9862-28411d1e066b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:19.576843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e9b9e-5e58-409c-b26e-36199156a9c5 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:19.611464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5670b-10ff-4599-977e-78a7a0c84f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:19.612130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5670b-10ff-4599-977e-78a7a0c84f2f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:19.612415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5670b-10ff-4599-977e-78a7a0c84f2f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:19.612691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5670b-10ff-4599-977e-78a7a0c84f2f None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:19.613395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5670b-10ff-4599-977e-78a7a0c84f2f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:19.613702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5670b-10ff-4599-977e-78a7a0c84f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:19.615096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d5670b-10ff-4599-977e-78a7a0c84f2f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:19.619883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 460/937] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:19.620703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5670b-10ff-4599-977e-78a7a0c84f2f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:19.669067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 478/938] 10.222.0.42 () {60 vars in 1144 bytes} [Fri May 27 13:40:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:40:19.670346 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eca4b-deae-4219-9862-28411d1e066b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:19.741512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5670b-10ff-4599-977e-78a7a0c84f2f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:19.789206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183648e-bdba-4e4d-a96d-7aae09c89560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:19.790023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183648e-bdba-4e4d-a96d-7aae09c89560 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:19.790297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183648e-bdba-4e4d-a96d-7aae09c89560 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:19.790571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183648e-bdba-4e4d-a96d-7aae09c89560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:19.794178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:19.805509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183648e-bdba-4e4d-a96d-7aae09c89560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:19.808101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183648e-bdba-4e4d-a96d-7aae09c89560 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:19.821082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eca4b-deae-4219-9862-28411d1e066b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-3183648e-bdba-4e4d-a96d-7aae09c89560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:19.835800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:19.836755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:19.837640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:19.837640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:19.837640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:19.837640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:19.840539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 461/939] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:19.845992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183648e-bdba-4e4d-a96d-7aae09c89560 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:19.866919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f89a5-494a-4327-a814-800473528722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:19.867726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f89a5-494a-4327-a814-800473528722 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:19.868109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f89a5-494a-4327-a814-800473528722 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:19.868415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f89a5-494a-4327-a814-800473528722 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:19.869229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f89a5-494a-4327-a814-800473528722 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:19.872020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f89a5-494a-4327-a814-800473528722 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:19.975814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183648e-bdba-4e4d-a96d-7aae09c89560 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:20.017020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b48ae-88f6-4bdd-a32c-584ea0b9519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:20.017659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b48ae-88f6-4bdd-a32c-584ea0b9519e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:20.017945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b48ae-88f6-4bdd-a32c-584ea0b9519e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:20.018226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b48ae-88f6-4bdd-a32c-584ea0b9519e None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:20.018960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b48ae-88f6-4bdd-a32c-584ea0b9519e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:20.019318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b48ae-88f6-4bdd-a32c-584ea0b9519e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:20.020776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b48ae-88f6-4bdd-a32c-584ea0b9519e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:20.033643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 462/940] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:20.038872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b48ae-88f6-4bdd-a32c-584ea0b9519e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:20.074074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 479/941] 10.222.0.42 () {60 vars in 1144 bytes} [Fri May 27 13:40:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:40:20.107847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:20.169323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b48ae-88f6-4bdd-a32c-584ea0b9519e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:20.217157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e00c26-15a2-4476-942e-4d63d17463d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:20.217994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e00c26-15a2-4476-942e-4d63d17463d7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:20.218280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e00c26-15a2-4476-942e-4d63d17463d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:20.218562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e00c26-15a2-4476-942e-4d63d17463d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:20.227198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e00c26-15a2-4476-942e-4d63d17463d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:20.228789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e00c26-15a2-4476-942e-4d63d17463d7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-d8e00c26-15a2-4476-942e-4d63d17463d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:20.247329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:20.248754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:20.250464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:20.250464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:20.250464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:20.250464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:20.250464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:20.250464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:20.250464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:20.250464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:20.250464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 463/942] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:20.255506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f89a5-494a-4327-a814-800473528722 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:20.259611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:20.378890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f89a5-494a-4327-a814-800473528722 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:20.415320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2073ce6-9cba-4127-9bcb-1683d3828087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:20.416350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2073ce6-9cba-4127-9bcb-1683d3828087 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:20.416860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2073ce6-9cba-4127-9bcb-1683d3828087 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:20.417332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2073ce6-9cba-4127-9bcb-1683d3828087 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:20.418396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2073ce6-9cba-4127-9bcb-1683d3828087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:20.418909 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2073ce6-9cba-4127-9bcb-1683d3828087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:20.420880 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2073ce6-9cba-4127-9bcb-1683d3828087 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:20.435562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 480/943] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:20.441532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e00c26-15a2-4476-942e-4d63d17463d7 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:20.552583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e00c26-15a2-4476-942e-4d63d17463d7 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:20.555882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:20.596564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ebb4c-39e4-49aa-b645-f90172b2112d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:20.597837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ebb4c-39e4-49aa-b645-f90172b2112d None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:20.598337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ebb4c-39e4-49aa-b645-f90172b2112d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:20.598799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ebb4c-39e4-49aa-b645-f90172b2112d None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/604a6139cec24af6a40c5eee3f197b7b/roles/d88071d05f2e438dbbe25f0bcd08b9a4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:20.601413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ebb4c-39e4-49aa-b645-f90172b2112d None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=604a6139cec24af6a40c5eee3f197b7b, role_id=d88071d05f2e438dbbe25f0bcd08b9a4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:20.603195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ebb4c-39e4-49aa-b645-f90172b2112d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:20.686148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 464/944] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:40:20 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/604a6139cec24af6a40c5eee3f197b7b/roles/d88071d05f2e438dbbe25f0bcd08b9a4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:40:20.770841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820803e5-7f74-4026-aaed-bd1e0e497688 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:20.771410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820803e5-7f74-4026-aaed-bd1e0e497688 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:20.771410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820803e5-7f74-4026-aaed-bd1e0e497688 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:20.773112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 481/945] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:20.780591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc4ac-d80a-484b-a20a-17943573fcc3 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:20.780591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc4ac-d80a-484b-a20a-17943573fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:20.780591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc4ac-d80a-484b-a20a-17943573fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:20.798913 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-381cc4ac-d80a-484b-a20a-17943573fcc3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:20.800738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-381cc4ac-d80a-484b-a20a-17943573fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:20.879926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 465/946] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:20.904764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820803e5-7f74-4026-aaed-bd1e0e497688 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:20.979383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:21.020421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820803e5-7f74-4026-aaed-bd1e0e497688 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:21.057763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81de32-d8fb-4eb6-a919-b05f5156d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:21.058578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81de32-d8fb-4eb6-a919-b05f5156d135 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:21.059448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81de32-d8fb-4eb6-a919-b05f5156d135 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:21.059730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81de32-d8fb-4eb6-a919-b05f5156d135 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:21.060385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81de32-d8fb-4eb6-a919-b05f5156d135 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:21.061755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81de32-d8fb-4eb6-a919-b05f5156d135 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ed81de32-d8fb-4eb6-a919-b05f5156d135 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:21.074066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:21.075114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:21.075946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 482/947] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:21.081761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc4ac-d80a-484b-a20a-17943573fcc3 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:21.176206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:21.182900 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc4ac-d80a-484b-a20a-17943573fcc3 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:21.219874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a9a8b-527f-49d0-b88d-782cd20ee7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:21.220908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a9a8b-527f-49d0-b88d-782cd20ee7a8 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:21.221408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a9a8b-527f-49d0-b88d-782cd20ee7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:21.221893 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a9a8b-527f-49d0-b88d-782cd20ee7a8 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:21.222810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a9a8b-527f-49d0-b88d-782cd20ee7a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:21.223340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a9a8b-527f-49d0-b88d-782cd20ee7a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:21.225028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a9a8b-527f-49d0-b88d-782cd20ee7a8 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:21.230575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 466/948] 10.222.0.42 () {56 vars in 1122 bytes} [Fri May 27 13:40:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:21.236133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81de32-d8fb-4eb6-a919-b05f5156d135 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:21.350678 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81de32-d8fb-4eb6-a919-b05f5156d135 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:21.380793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:21.390183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f737e24-9f46-43bb-a2ed-ce5fdcd3c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:21.390900 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737e24-9f46-43bb-a2ed-ce5fdcd3c122 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:21.391220 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737e24-9f46-43bb-a2ed-ce5fdcd3c122 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:21.391501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f737e24-9f46-43bb-a2ed-ce5fdcd3c122 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:21.392211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f737e24-9f46-43bb-a2ed-ce5fdcd3c122 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:21.392519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f737e24-9f46-43bb-a2ed-ce5fdcd3c122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:21.393893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f737e24-9f46-43bb-a2ed-ce5fdcd3c122 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:21.403102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 483/949] 10.222.0.42 () {56 vars in 1122 bytes} [Fri May 27 13:40:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:21.405233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a9a8b-527f-49d0-b88d-782cd20ee7a8 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:21.517405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a9a8b-527f-49d0-b88d-782cd20ee7a8 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:21.559980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f6c55-7a5e-4a89-9376-2f03f4f6ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:21.561546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f6c55-7a5e-4a89-9376-2f03f4f6ecdd None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:21.562040 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f6c55-7a5e-4a89-9376-2f03f4f6ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:21.562561 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f6c55-7a5e-4a89-9376-2f03f4f6ecdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:21.563589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f6c55-7a5e-4a89-9376-2f03f4f6ecdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:21.565199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f6c55-7a5e-4a89-9376-2f03f4f6ecdd None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:21.659508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 467/950] 10.222.0.42 () {60 vars in 1144 bytes} [Fri May 27 13:40:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:40:22.098521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b086f3-a6a8-44be-b0c7-e9e9460f1b61 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:22.099104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b086f3-a6a8-44be-b0c7-e9e9460f1b61 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:22.099104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b086f3-a6a8-44be-b0c7-e9e9460f1b61 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:22.101356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 484/951] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:22.107526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d773c-b02e-48ce-bd44-917f7d63d5bc None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:22.107820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d773c-b02e-48ce-bd44-917f7d63d5bc None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:22.108103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d773c-b02e-48ce-bd44-917f7d63d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:22.128332 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a12d773c-b02e-48ce-bd44-917f7d63d5bc None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:22.129547 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a12d773c-b02e-48ce-bd44-917f7d63d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:22.148792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:22.235086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 468/952] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:22.255725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b086f3-a6a8-44be-b0c7-e9e9460f1b61 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:22.367470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b086f3-a6a8-44be-b0c7-e9e9460f1b61 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:22.403642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0e6b0-f9ba-4e98-963b-0e01cbf3407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:22.404322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e6b0-f9ba-4e98-963b-0e01cbf3407b None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:22.404600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e6b0-f9ba-4e98-963b-0e01cbf3407b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:22.404875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0e6b0-f9ba-4e98-963b-0e01cbf3407b None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:22.405816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0e6b0-f9ba-4e98-963b-0e01cbf3407b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:22.407434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0e6b0-f9ba-4e98-963b-0e01cbf3407b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:22.408870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WARNING keystone.server.flask.common [None req-10c0e6b0-f9ba-4e98-963b-0e01cbf3407b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 13:40:22.507740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.sql.core [None req-10c0e6b0-f9ba-4e98-963b-0e01cbf3407b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 13:40:22.507740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 13:40:22.507740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [parameters: {'id': '9556467875814e42b0494cf2c390ecaf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 13:40:22.507740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92064) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-10c0e6b0-f9ba-4e98-963b-0e01cbf3407b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9556467875814e42b0494cf2c390ecaf.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9556467875814e42b0494cf2c390ecaf. May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application result = self._query(query) May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application conn.query(q) May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 13:40:22.526093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application result.read() May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 13:40:22.528691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application next(self.gen) May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application yield resource May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application next(self.gen) May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self.session.rollback() May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self.force_reraise() May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise self.value May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application session.commit() May 27 13:40:22.531029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._prepare_impl() May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self.session.flush() May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._flush(objects) May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application compat.raise_( May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application flush_context.execute() May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 13:40:22.533188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rec.execute(self) May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 13:40:22.535624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application result = self._query(query) May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application conn.query(q) May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application result.read() May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 13:40:22.537558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [parameters: {'id': '9556467875814e42b0494cf2c390ecaf', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:22.539764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:22.541697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:22.544188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:22.544188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 13:40:22.544188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 13:40:22.544188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:22.544188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:22.544188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 13:40:22.544188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 13:40:22.544188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9556467875814e42b0494cf2c390ecaf. May 27 13:40:22.544188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:22.544188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 485/953] 10.222.0.42 () {60 vars in 1140 bytes} [Fri May 27 13:40:22 2022] POST /identity/v3/projects => generated 262 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:22.545594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d773c-b02e-48ce-bd44-917f7d63d5bc None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:22.621401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115106-0d02-4641-bbec-c01e9a112e16 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:22.621401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115106-0d02-4641-bbec-c01e9a112e16 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:22.621401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115106-0d02-4641-bbec-c01e9a112e16 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:22.621401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 486/954] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:22.627550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e063-75cc-4798-a81c-15d9db02f350 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:22.628158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e063-75cc-4798-a81c-15d9db02f350 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:22.628649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097e063-75cc-4798-a81c-15d9db02f350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:22.645198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d773c-b02e-48ce-bd44-917f7d63d5bc None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:22.649045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-6097e063-75cc-4798-a81c-15d9db02f350 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:22.650854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6097e063-75cc-4798-a81c-15d9db02f350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:22.690083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4aec-43e6-4fc0-b3ea-201180a092af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:22.690853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4aec-43e6-4fc0-b3ea-201180a092af None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:22.691178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4aec-43e6-4fc0-b3ea-201180a092af None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:22.691456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4aec-43e6-4fc0-b3ea-201180a092af None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:22.700390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be4aec-43e6-4fc0-b3ea-201180a092af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:22.702513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be4aec-43e6-4fc0-b3ea-201180a092af None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:22.703564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:22.707162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-66be4aec-43e6-4fc0-b3ea-201180a092af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:22.723188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:22.724138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:22.725151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:22.725151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:22.725151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:22.725151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:22.725151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:22.725151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:22.725151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:22.725151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:22.727070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 469/955] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:22.731022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4aec-43e6-4fc0-b3ea-201180a092af None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:22.743103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 487/956] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:22.766122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e063-75cc-4798-a81c-15d9db02f350 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:22.889141 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4aec-43e6-4fc0-b3ea-201180a092af None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:22.892457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097e063-75cc-4798-a81c-15d9db02f350 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:22.936102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e20c0-3667-47fc-b8be-05b1f5f02697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:22.937494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e20c0-3667-47fc-b8be-05b1f5f02697 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:22.937982 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e20c0-3667-47fc-b8be-05b1f5f02697 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:22.938254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b874f-253f-4fca-b20f-a29afe9cfca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:22.938715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e20c0-3667-47fc-b8be-05b1f5f02697 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:22.938925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b874f-253f-4fca-b20f-a29afe9cfca1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:22.939242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b874f-253f-4fca-b20f-a29afe9cfca1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:22.939522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b874f-253f-4fca-b20f-a29afe9cfca1 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:22.940217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e20c0-3667-47fc-b8be-05b1f5f02697 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:22.940321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b874f-253f-4fca-b20f-a29afe9cfca1 None admin] RBAC: Adding query filter params (name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:22.940623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b874f-253f-4fca-b20f-a29afe9cfca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:22.942095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b874f-253f-4fca-b20f-a29afe9cfca1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:22.942438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e20c0-3667-47fc-b8be-05b1f5f02697 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-8b2e20c0-3667-47fc-b8be-05b1f5f02697 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:22.957064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:22.958143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 13:40:22.959030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:22.963021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 488/957] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:22.967190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e20c0-3667-47fc-b8be-05b1f5f02697 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:22.969749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 470/958] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:23.012622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521683c-7117-4cee-8524-fc5cef6710aa None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:23.012979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521683c-7117-4cee-8524-fc5cef6710aa None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:23.013322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521683c-7117-4cee-8524-fc5cef6710aa None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:23.019250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:23.019454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 471/959] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:23.021888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572127f-1832-4619-8e49-057aa5fbbd65 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:23.022176 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572127f-1832-4619-8e49-057aa5fbbd65 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:23.022448 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572127f-1832-4619-8e49-057aa5fbbd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:23.041657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-1572127f-1832-4619-8e49-057aa5fbbd65 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:23.042895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1572127f-1832-4619-8e49-057aa5fbbd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:23.090857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e20c0-3667-47fc-b8be-05b1f5f02697 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:23.112025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:23.131505 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 472/960] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:23.132377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49099bd1-45b9-4398-bee0-be1c5ae9d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:23.133576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49099bd1-45b9-4398-bee0-be1c5ae9d0ec None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:23.134017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49099bd1-45b9-4398-bee0-be1c5ae9d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:23.134626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49099bd1-45b9-4398-bee0-be1c5ae9d0ec None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:23.135609 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49099bd1-45b9-4398-bee0-be1c5ae9d0ec None admin] RBAC: Adding query filter params (name=compute) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:23.136068 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49099bd1-45b9-4398-bee0-be1c5ae9d0ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:23.138213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49099bd1-45b9-4398-bee0-be1c5ae9d0ec None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:23.144702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 489/961] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:23.152905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572127f-1832-4619-8e49-057aa5fbbd65 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:23.154411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49099bd1-45b9-4398-bee0-be1c5ae9d0ec None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:23.280443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572127f-1832-4619-8e49-057aa5fbbd65 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:23.282616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49099bd1-45b9-4398-bee0-be1c5ae9d0ec None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:23.293003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:23.320103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e6840-6d00-4eeb-8119-37113d8e3dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:23.320925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e6840-6d00-4eeb-8119-37113d8e3dce None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:23.321211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e6840-6d00-4eeb-8119-37113d8e3dce None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:23.321483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e6840-6d00-4eeb-8119-37113d8e3dce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:23.325453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f02d1b-18a7-42b7-aeb0-933e0b12b661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:23.326134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02d1b-18a7-42b7-aeb0-933e0b12b661 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:23.326416 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02d1b-18a7-42b7-aeb0-933e0b12b661 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:23.326845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02d1b-18a7-42b7-aeb0-933e0b12b661 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:23.327896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02d1b-18a7-42b7-aeb0-933e0b12b661 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:23.328294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02d1b-18a7-42b7-aeb0-933e0b12b661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:23.331225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02d1b-18a7-42b7-aeb0-933e0b12b661 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:23.336418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115e6840-6d00-4eeb-8119-37113d8e3dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:23.342643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 473/962] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-115e6840-6d00-4eeb-8119-37113d8e3dce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:23.347037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:23.348007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:23.348825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:23.354184 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 490/963] 10.222.0.42 () {56 vars in 1120 bytes} [Fri May 27 13:40:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:23.354406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f02d1b-18a7-42b7-aeb0-933e0b12b661 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:23.426940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:23.482731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f02d1b-18a7-42b7-aeb0-933e0b12b661 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:23.525578 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e66e-033d-48da-817a-87bc41b7539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:23.526285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e66e-033d-48da-817a-87bc41b7539e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:23.526574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e66e-033d-48da-817a-87bc41b7539e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:23.526853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e66e-033d-48da-817a-87bc41b7539e None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:23.527717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3e66e-033d-48da-817a-87bc41b7539e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:23.528212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3e66e-033d-48da-817a-87bc41b7539e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:23.529894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3e66e-033d-48da-817a-87bc41b7539e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:23.540013 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 474/964] 10.222.0.42 () {56 vars in 1115 bytes} [Fri May 27 13:40:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:23.545739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e6840-6d00-4eeb-8119-37113d8e3dce None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:23.662492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e6840-6d00-4eeb-8119-37113d8e3dce None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:23.702128 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8643d-5b68-44c8-8a4c-9949fb108d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:23.703011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8643d-5b68-44c8-8a4c-9949fb108d24 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:23.703296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8643d-5b68-44c8-8a4c-9949fb108d24 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:23.703568 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8643d-5b68-44c8-8a4c-9949fb108d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:23.714777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8643d-5b68-44c8-8a4c-9949fb108d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:23.716509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8643d-5b68-44c8-8a4c-9949fb108d24 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-98e8643d-5b68-44c8-8a4c-9949fb108d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:23.734763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:23.736812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:23.738064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:23.738064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:23.738064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:23.738064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:23.738064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 491/965] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:23.741620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e66e-033d-48da-817a-87bc41b7539e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:23.849512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e66e-033d-48da-817a-87bc41b7539e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:23.867364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:23.886437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ae459-8777-4e4d-9ffb-b08f5749ec7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:23.887647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ae459-8777-4e4d-9ffb-b08f5749ec7d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:23.887927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ae459-8777-4e4d-9ffb-b08f5749ec7d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:23.888254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ae459-8777-4e4d-9ffb-b08f5749ec7d None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:23.891142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ae459-8777-4e4d-9ffb-b08f5749ec7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:23.891142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ae459-8777-4e4d-9ffb-b08f5749ec7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:23.891142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ae459-8777-4e4d-9ffb-b08f5749ec7d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:23.904114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 475/966] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:23.912067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8643d-5b68-44c8-8a4c-9949fb108d24 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:23.943015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:24.034309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8643d-5b68-44c8-8a4c-9949fb108d24 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:24.068775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5150bc4-2b9e-4d45-b8f0-313785eab8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:24.069570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5150bc4-2b9e-4d45-b8f0-313785eab8aa None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:24.069847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5150bc4-2b9e-4d45-b8f0-313785eab8aa None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:24.070115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5150bc4-2b9e-4d45-b8f0-313785eab8aa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:24.077881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5150bc4-2b9e-4d45-b8f0-313785eab8aa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:24.079340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5150bc4-2b9e-4d45-b8f0-313785eab8aa None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-f5150bc4-2b9e-4d45-b8f0-313785eab8aa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:24.095070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:24.096045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:24.096981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 492/967] 10.222.0.42 () {56 vars in 1117 bytes} [Fri May 27 13:40:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:24.102583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ae459-8777-4e4d-9ffb-b08f5749ec7d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:24.147727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1471b34-50c2-42ae-b32c-0bf5c4c59b30 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:24.148685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1471b34-50c2-42ae-b32c-0bf5c4c59b30 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:24.149170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1471b34-50c2-42ae-b32c-0bf5c4c59b30 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:24.151013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 493/968] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:24.156741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79b2b-e8dd-44da-ad3a-9360fe0a7641 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:24.157272 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79b2b-e8dd-44da-ad3a-9360fe0a7641 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:24.157772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79b2b-e8dd-44da-ad3a-9360fe0a7641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:24.176301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-94b79b2b-e8dd-44da-ad3a-9360fe0a7641 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:24.178011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-94b79b2b-e8dd-44da-ad3a-9360fe0a7641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:24.222539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ae459-8777-4e4d-9ffb-b08f5749ec7d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:24.263478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 494/969] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:24.267071 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449b167-9447-4918-9cef-27a9a261f785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:24.267697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b167-9447-4918-9cef-27a9a261f785 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:24.267977 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b167-9447-4918-9cef-27a9a261f785 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:24.268251 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449b167-9447-4918-9cef-27a9a261f785 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:24.269098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449b167-9447-4918-9cef-27a9a261f785 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:24.269403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449b167-9447-4918-9cef-27a9a261f785 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:24.270843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449b167-9447-4918-9cef-27a9a261f785 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:24.284453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b79b2b-e8dd-44da-ad3a-9360fe0a7641 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:24.291802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 476/970] 10.222.0.42 () {56 vars in 1149 bytes} [Fri May 27 13:40:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:24.300546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449b167-9447-4918-9cef-27a9a261f785 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:24.300704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:24.332925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:24.409267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449b167-9447-4918-9cef-27a9a261f785 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:24.414415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b79b2b-e8dd-44da-ad3a-9360fe0a7641 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:24.450923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6fd6a-8acf-4884-8af2-1f0ea630de71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:24.451766 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6fd6a-8acf-4884-8af2-1f0ea630de71 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:24.452048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6fd6a-8acf-4884-8af2-1f0ea630de71 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:24.452324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6fd6a-8acf-4884-8af2-1f0ea630de71 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:24.452985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6fd6a-8acf-4884-8af2-1f0ea630de71 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:24.454565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6fd6a-8acf-4884-8af2-1f0ea630de71 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:24.457953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc40d7-179f-4747-9521-7d1e5fee1934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:24.458947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc40d7-179f-4747-9521-7d1e5fee1934 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:24.459316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc40d7-179f-4747-9521-7d1e5fee1934 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:24.459656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc40d7-179f-4747-9521-7d1e5fee1934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-a0b6fd6a-8acf-4884-8af2-1f0ea630de71 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:24.467792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:24.469021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:24.470073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 495/971] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:24.477416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6fd6a-8acf-4884-8af2-1f0ea630de71 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:24.546632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc40d7-179f-4747-9521-7d1e5fee1934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:24.548279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc40d7-179f-4747-9521-7d1e5fee1934 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:24.568816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:24.592905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:24.606738 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6fd6a-8acf-4884-8af2-1f0ea630de71 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:24.644223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d9eac-268d-48bc-bbd7-2f73e362bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:24.645268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d9eac-268d-48bc-bbd7-2f73e362bb7c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:24.649640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d9eac-268d-48bc-bbd7-2f73e362bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:24.651786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d9eac-268d-48bc-bbd7-2f73e362bb7c None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:24.652524 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d9eac-268d-48bc-bbd7-2f73e362bb7c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:24.653346 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d9eac-268d-48bc-bbd7-2f73e362bb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:24.654813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d9eac-268d-48bc-bbd7-2f73e362bb7c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:24.662358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 496/972] 10.222.0.42 () {56 vars in 1122 bytes} [Fri May 27 13:40:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:24.668132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d9eac-268d-48bc-bbd7-2f73e362bb7c None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:24.693654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 477/973] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:24 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:40:24.698875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc40d7-179f-4747-9521-7d1e5fee1934 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:24.787019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d9eac-268d-48bc-bbd7-2f73e362bb7c None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:24.805510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc40d7-179f-4747-9521-7d1e5fee1934 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:24.827994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47674a-a76f-4a75-895c-f6d9a04ac360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:24.829039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47674a-a76f-4a75-895c-f6d9a04ac360 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:24.829526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47674a-a76f-4a75-895c-f6d9a04ac360 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:24.830051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47674a-a76f-4a75-895c-f6d9a04ac360 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:24.831091 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47674a-a76f-4a75-895c-f6d9a04ac360 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:24.831621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47674a-a76f-4a75-895c-f6d9a04ac360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:24.833325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47674a-a76f-4a75-895c-f6d9a04ac360 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:24.835839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:24.840855 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 497/974] 10.222.0.42 () {56 vars in 1122 bytes} [Fri May 27 13:40:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:24.846404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47674a-a76f-4a75-895c-f6d9a04ac360 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:24.847538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72787-9f08-4f14-a8d4-3a56b1dccd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:24.848342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72787-9f08-4f14-a8d4-3a56b1dccd32 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:24.848626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72787-9f08-4f14-a8d4-3a56b1dccd32 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:24.848899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72787-9f08-4f14-a8d4-3a56b1dccd32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:24.851320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:24.862847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a72787-9f08-4f14-a8d4-3a56b1dccd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:24.864646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a72787-9f08-4f14-a8d4-3a56b1dccd32 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-d3a72787-9f08-4f14-a8d4-3a56b1dccd32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:24.890825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:24.891839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:24.892961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:24.892961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:24.892961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:24.892961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:24.892961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 478/975] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:24.897837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72787-9f08-4f14-a8d4-3a56b1dccd32 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:24.964493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47674a-a76f-4a75-895c-f6d9a04ac360 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:25.002196 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c086c0a-8b30-4395-9467-234ff742b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:25.002726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086c0a-8b30-4395-9467-234ff742b47f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.003051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086c0a-8b30-4395-9467-234ff742b47f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.003333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c086c0a-8b30-4395-9467-234ff742b47f None admin] PATH_INFO: `/v3/endpoints` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.004132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c086c0a-8b30-4395-9467-234ff742b47f None admin] RBAC: Adding query filter params (interface=admin, service_id=8970010cda4641b38333c34b298f0732, region_id=RegionOne) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:25.004446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c086c0a-8b30-4395-9467-234ff742b47f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:25.005822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c086c0a-8b30-4395-9467-234ff742b47f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:25.006388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72787-9f08-4f14-a8d4-3a56b1dccd32 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:25.016234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 498/976] 10.222.0.42 () {56 vars in 1249 bytes} [Fri May 27 13:40:24 2022] GET /identity/v3/endpoints?service_id=8970010cda4641b38333c34b298f0732&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:25.018643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c086c0a-8b30-4395-9467-234ff742b47f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:25.052290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd87b4-9c4d-40e8-a25d-11f3a965dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:25.053535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd87b4-9c4d-40e8-a25d-11f3a965dae9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.054134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd87b4-9c4d-40e8-a25d-11f3a965dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.054619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd87b4-9c4d-40e8-a25d-11f3a965dae9 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.055702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd87b4-9c4d-40e8-a25d-11f3a965dae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:25.056271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd87b4-9c4d-40e8-a25d-11f3a965dae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:25.058049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd87b4-9c4d-40e8-a25d-11f3a965dae9 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:25.071688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 479/977] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:25.078294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd87b4-9c4d-40e8-a25d-11f3a965dae9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:25.091137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:25.130305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c086c0a-8b30-4395-9467-234ff742b47f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:25.133654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:25.166540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6f1d-4d26-4526-ad38-15993219ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:25.167246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6f1d-4d26-4526-ad38-15993219ec64 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.169334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6f1d-4d26-4526-ad38-15993219ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.169806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b6f1d-4d26-4526-ad38-15993219ec64 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.170671 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b6f1d-4d26-4526-ad38-15993219ec64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:25.172398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b6f1d-4d26-4526-ad38-15993219ec64 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:25.180370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 499/978] 10.222.0.42 () {56 vars in 1087 bytes} [Fri May 27 13:40:25 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 13:40:25.208382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd87b4-9c4d-40e8-a25d-11f3a965dae9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:25.248880 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc550b-fe77-46bd-a682-6f1868685697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:25.249967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc550b-fe77-46bd-a682-6f1868685697 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.250406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc550b-fe77-46bd-a682-6f1868685697 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.250825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc550b-fe77-46bd-a682-6f1868685697 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.259203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc550b-fe77-46bd-a682-6f1868685697 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:25.261040 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc550b-fe77-46bd-a682-6f1868685697 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-20fc550b-fe77-46bd-a682-6f1868685697 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:25.278541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:25.279723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:25.280813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:25.280813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:25.280813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:25.280813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:25.280813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:25.280813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:25.280813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:25.280813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:25.283160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 480/979] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:25.288682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6f1d-4d26-4526-ad38-15993219ec64 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:25.382537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ebead-9a97-4244-a52a-a866b1b04753 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.383650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ebead-9a97-4244-a52a-a866b1b04753 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.384168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ebead-9a97-4244-a52a-a866b1b04753 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.386573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 481/980] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:25.395321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4f8a5-89de-4197-a65a-9d45c8a99531 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.395638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4f8a5-89de-4197-a65a-9d45c8a99531 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.395905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4f8a5-89de-4197-a65a-9d45c8a99531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.404553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b6f1d-4d26-4526-ad38-15993219ec64 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:25.416211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-5ca4f8a5-89de-4197-a65a-9d45c8a99531 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:25.418558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5ca4f8a5-89de-4197-a65a-9d45c8a99531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:25.437586 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:25.446206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24da89-f2b1-446f-bf77-308828c16d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:25.450987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24da89-f2b1-446f-bf77-308828c16d8f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.450987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24da89-f2b1-446f-bf77-308828c16d8f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.450987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24da89-f2b1-446f-bf77-308828c16d8f None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.450987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24da89-f2b1-446f-bf77-308828c16d8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:25.450987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24da89-f2b1-446f-bf77-308828c16d8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:25.450987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24da89-f2b1-446f-bf77-308828c16d8f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:25.463191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 500/981] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:25.469701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24da89-f2b1-446f-bf77-308828c16d8f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:25.499903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 482/982] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:25.526633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4f8a5-89de-4197-a65a-9d45c8a99531 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:25.567881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:25.580205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24da89-f2b1-446f-bf77-308828c16d8f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:25.616425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2a4d1-b31e-48a0-b4ae-6081b736b839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:25.617084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a4d1-b31e-48a0-b4ae-6081b736b839 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.617365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a4d1-b31e-48a0-b4ae-6081b736b839 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.617637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2a4d1-b31e-48a0-b4ae-6081b736b839 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.618668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2a4d1-b31e-48a0-b4ae-6081b736b839 None admin] RBAC: Adding query filter params (role.id=d88071d05f2e438dbbe25f0bcd08b9a4, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=604a6139cec24af6a40c5eee3f197b7b) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:25.618789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2a4d1-b31e-48a0-b4ae-6081b736b839 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:25.620200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2a4d1-b31e-48a0-b4ae-6081b736b839 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:25.633078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 501/983] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:25 2022] GET /identity/v3/role_assignments?user.id=604a6139cec24af6a40c5eee3f197b7b&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=d88071d05f2e438dbbe25f0bcd08b9a4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:25.649044 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4f8a5-89de-4197-a65a-9d45c8a99531 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:25.693293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:25.693985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.694267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.694542 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.695292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:25.696773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:25.698202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: WARNING keystone.server.flask.common [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 13:40:25.730026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aada7d-e982-417b-bb1b-4a2b5933adfe None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.730309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aada7d-e982-417b-bb1b-4a2b5933adfe None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.731000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aada7d-e982-417b-bb1b-4a2b5933adfe None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.732438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 502/984] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:25.738125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db1894-1575-4f20-82d9-e0a49f3671f4 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.738415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db1894-1575-4f20-82d9-e0a49f3671f4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.738696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db1894-1575-4f20-82d9-e0a49f3671f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.748401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.sql.core [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 13:40:25.748401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 13:40:25.748401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [parameters: {'user_id': '1cb2c8987a574a2d84e8a14b4f5c6229', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 13:40:25.748401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92065) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application result = self._query(query) May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application conn.query(q) May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application result.read() May 27 13:40:25.757129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 13:40:25.758072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application next(self.gen) May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application yield resource May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application next(self.gen) May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self.session.rollback() May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self.force_reraise() May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise self.value May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application session.commit() May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 13:40:25.759050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._prepare_impl() May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self.session.flush() May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._flush(objects) May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application compat.raise_( May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application flush_context.execute() May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rec.execute(self) May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 13:40:25.759946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 13:40:25.763103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application result = self._query(query) May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application conn.query(q) May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application result.read() May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 13:40:25.764466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [parameters: {'user_id': '1cb2c8987a574a2d84e8a14b4f5c6229', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:25.766681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 13:40:25.773433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 13:40:25.775816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 13:40:25.775816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 13:40:25.775816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 13:40:25.775816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 13:40:25.775816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 13:40:25.775816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:25.776605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-31db1894-1575-4f20-82d9-e0a49f3671f4 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:25.776748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 483/985] 10.222.0.42 () {60 vars in 1131 bytes} [Fri May 27 13:40:25 2022] POST /identity/v3/users => generated 160 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:25.776877 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-31db1894-1575-4f20-82d9-e0a49f3671f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:25.777017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:25.816046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:25.845946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 503/986] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:25.869123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db1894-1575-4f20-82d9-e0a49f3671f4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:25.908805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:25.912607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642a168-9cd6-443d-b981-481d6b002d5b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:25.959261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4cf1e-e21b-495a-a4b5-64d31b4c0a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:25.961493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4cf1e-e21b-495a-a4b5-64d31b4c0a6d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:25.961776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4cf1e-e21b-495a-a4b5-64d31b4c0a6d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:25.962104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc4cf1e-e21b-495a-a4b5-64d31b4c0a6d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:25.972304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4cf1e-e21b-495a-a4b5-64d31b4c0a6d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:25.974871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc4cf1e-e21b-495a-a4b5-64d31b4c0a6d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:25.988523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db1894-1575-4f20-82d9-e0a49f3671f4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-9fc4cf1e-e21b-495a-a4b5-64d31b4c0a6d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:25.995988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:25.997011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:25.997955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:25.997955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:25.997955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:25.997955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:25.997955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:25.997955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:25.997955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:25.997955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:25.997955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 13:40:25.997955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:26.002992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 484/987] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:40:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:26.007912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4cf1e-e21b-495a-a4b5-64d31b4c0a6d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:26.031965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4babbb-aa2f-4ad6-8eb7-1f252af34ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:26.032638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4babbb-aa2f-4ad6-8eb7-1f252af34ff3 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:26.032932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4babbb-aa2f-4ad6-8eb7-1f252af34ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:26.033196 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4babbb-aa2f-4ad6-8eb7-1f252af34ff3 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:26.034011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4babbb-aa2f-4ad6-8eb7-1f252af34ff3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:26.035704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4babbb-aa2f-4ad6-8eb7-1f252af34ff3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:26.107134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 504/988] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:40:25 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:40:26.142243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc4cf1e-e21b-495a-a4b5-64d31b4c0a6d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:26.204937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ca83f-d215-4fd9-a72d-0aac99a94fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:26.205925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ca83f-d215-4fd9-a72d-0aac99a94fcf None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:26.206399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ca83f-d215-4fd9-a72d-0aac99a94fcf None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:26.206874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ca83f-d215-4fd9-a72d-0aac99a94fcf None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:26.208047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ca83f-d215-4fd9-a72d-0aac99a94fcf None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:26.208572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ca83f-d215-4fd9-a72d-0aac99a94fcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:26.210364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ca83f-d215-4fd9-a72d-0aac99a94fcf None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:26.252573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 485/989] 10.222.0.42 () {56 vars in 1101 bytes} [Fri May 27 13:40:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:27.534857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ad16d-406f-4ce8-9648-f1d55de80a41 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:27.535421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ad16d-406f-4ce8-9648-f1d55de80a41 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:27.535421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ad16d-406f-4ce8-9648-f1d55de80a41 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:27.536946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 505/990] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:27.542083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3618db9-43b4-45e8-ad68-ad52857505df None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:27.542469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3618db9-43b4-45e8-ad68-ad52857505df None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:27.542635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3618db9-43b4-45e8-ad68-ad52857505df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:27.560152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-d3618db9-43b4-45e8-ad68-ad52857505df None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:27.561659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d3618db9-43b4-45e8-ad68-ad52857505df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:27.569720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:27.629546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 486/991] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:27.652335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ad16d-406f-4ce8-9648-f1d55de80a41 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:27.703928 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:27.761856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ad16d-406f-4ce8-9648-f1d55de80a41 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:27.796780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2563b6-6e29-4f37-8005-9ef6db7153d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:27.797496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2563b6-6e29-4f37-8005-9ef6db7153d8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:27.797773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2563b6-6e29-4f37-8005-9ef6db7153d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:27.798044 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2563b6-6e29-4f37-8005-9ef6db7153d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:27.798697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2563b6-6e29-4f37-8005-9ef6db7153d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:27.800374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2563b6-6e29-4f37-8005-9ef6db7153d8 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ee2563b6-6e29-4f37-8005-9ef6db7153d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:27.813829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:27.814911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 13:40:27.815809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:27.817293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 506/992] 10.222.0.42 () {56 vars in 1126 bytes} [Fri May 27 13:40:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:27.821455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3618db9-43b4-45e8-ad68-ad52857505df None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:27.923857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3618db9-43b4-45e8-ad68-ad52857505df None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:27.957662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd94382-c39b-49d7-9760-8b79aa62dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:27.958330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd94382-c39b-49d7-9760-8b79aa62dea3 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:27.958611 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd94382-c39b-49d7-9760-8b79aa62dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:27.958882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd94382-c39b-49d7-9760-8b79aa62dea3 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:27.959615 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd94382-c39b-49d7-9760-8b79aa62dea3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:27.959918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd94382-c39b-49d7-9760-8b79aa62dea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:27.961281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd94382-c39b-49d7-9760-8b79aa62dea3 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:27.967231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 487/993] 10.222.0.42 () {56 vars in 1122 bytes} [Fri May 27 13:40:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:27.972649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2563b6-6e29-4f37-8005-9ef6db7153d8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:28.004337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba0dd6-c119-4023-92c0-06167d169e8a None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.004628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba0dd6-c119-4023-92c0-06167d169e8a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.004901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba0dd6-c119-4023-92c0-06167d169e8a None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.006280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 488/994] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:28.011106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3990-d2c4-4caf-9d38-71b461921957 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.011396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3990-d2c4-4caf-9d38-71b461921957 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.011676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf3990-d2c4-4caf-9d38-71b461921957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.024851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:28.034196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-edcf3990-d2c4-4caf-9d38-71b461921957 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:28.035417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-edcf3990-d2c4-4caf-9d38-71b461921957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:28.081755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2563b6-6e29-4f37-8005-9ef6db7153d8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:28.089136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:28.111771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 489/995] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:28.117712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68349ef-ea4b-40d2-b631-750f9393e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:28.118374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68349ef-ea4b-40d2-b631-750f9393e59d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.118656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68349ef-ea4b-40d2-b631-750f9393e59d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.118930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68349ef-ea4b-40d2-b631-750f9393e59d None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.119662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68349ef-ea4b-40d2-b631-750f9393e59d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:28.119971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68349ef-ea4b-40d2-b631-750f9393e59d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:28.121374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68349ef-ea4b-40d2-b631-750f9393e59d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:28.126425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 507/996] 10.222.0.42 () {56 vars in 1122 bytes} [Fri May 27 13:40:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:28.132024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3990-d2c4-4caf-9d38-71b461921957 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:28.133736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68349ef-ea4b-40d2-b631-750f9393e59d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:28.246078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68349ef-ea4b-40d2-b631-750f9393e59d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:28.249149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf3990-d2c4-4caf-9d38-71b461921957 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:28.283913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3da4bf-6c5a-4e31-b9ec-e4b5bffe907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:28.284697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3da4bf-6c5a-4e31-b9ec-e4b5bffe907d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.284976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3da4bf-6c5a-4e31-b9ec-e4b5bffe907d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.285243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3da4bf-6c5a-4e31-b9ec-e4b5bffe907d None admin] PATH_INFO: `/v3/services/image` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.285884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41796791-5778-4f5b-8968-f0992f476e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:28.286002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3da4bf-6c5a-4e31-b9ec-e4b5bffe907d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:28.286546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796791-5778-4f5b-8968-f0992f476e06 None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.286832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796791-5778-4f5b-8968-f0992f476e06 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.287142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41796791-5778-4f5b-8968-f0992f476e06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.287302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3da4bf-6c5a-4e31-b9ec-e4b5bffe907d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:28.287880 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41796791-5778-4f5b-8968-f0992f476e06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:28.289239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41796791-5778-4f5b-8968-f0992f476e06 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:28.294487 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-8e3da4bf-6c5a-4e31-b9ec-e4b5bffe907d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:28.299374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:28.300864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:28.301821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 508/997] 10.222.0.42 () {56 vars in 1105 bytes} [Fri May 27 13:40:28 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:28.306635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3da4bf-6c5a-4e31-b9ec-e4b5bffe907d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:28.341510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:28.404269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3da4bf-6c5a-4e31-b9ec-e4b5bffe907d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:28.406419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 490/998] 10.222.0.42 () {60 vars in 1144 bytes} [Fri May 27 13:40:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:40:28.408024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73148a0-db10-4eca-ae01-3e162643479b None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.408327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73148a0-db10-4eca-ae01-3e162643479b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.408612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73148a0-db10-4eca-ae01-3e162643479b None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.410086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 491/999] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:28.415824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7bf4-113f-4fb4-97c5-5243ab0bb630 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.416134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7bf4-113f-4fb4-97c5-5243ab0bb630 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.416389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7bf4-113f-4fb4-97c5-5243ab0bb630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.435078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-6e7b7bf4-113f-4fb4-97c5-5243ab0bb630 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:28.436368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-6e7b7bf4-113f-4fb4-97c5-5243ab0bb630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:28.447361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5b85c-986d-4c7c-9e8d-5b67b7ff778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:28.448034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5b85c-986d-4c7c-9e8d-5b67b7ff778d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.448316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5b85c-986d-4c7c-9e8d-5b67b7ff778d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.448588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5b85c-986d-4c7c-9e8d-5b67b7ff778d None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.450047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5b85c-986d-4c7c-9e8d-5b67b7ff778d None admin] RBAC: Adding query filter params (name=image) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:28.450416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5b85c-986d-4c7c-9e8d-5b67b7ff778d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:28.451932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5b85c-986d-4c7c-9e8d-5b67b7ff778d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:28.457298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 509/1000] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:28.463042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5b85c-986d-4c7c-9e8d-5b67b7ff778d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:28.515337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 492/1001] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:28 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:28.539003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7bf4-113f-4fb4-97c5-5243ab0bb630 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:28.578314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:28.585459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5b85c-986d-4c7c-9e8d-5b67b7ff778d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:28.630763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0934c-aa79-4a54-8445-81a27af5683f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:28.631719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0934c-aa79-4a54-8445-81a27af5683f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.632288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0934c-aa79-4a54-8445-81a27af5683f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.632573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0934c-aa79-4a54-8445-81a27af5683f None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.633287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0934c-aa79-4a54-8445-81a27af5683f None admin] RBAC: Adding query filter params (type=image) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:28.633759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0934c-aa79-4a54-8445-81a27af5683f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:28.635808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0934c-aa79-4a54-8445-81a27af5683f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:28.651011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 510/1002] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:28.655132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7bf4-113f-4fb4-97c5-5243ab0bb630 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:28.689389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:28.698753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeaf3f-9253-4aee-b88a-1f97513da7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:28.699663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeaf3f-9253-4aee-b88a-1f97513da7f3 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.700263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeaf3f-9253-4aee-b88a-1f97513da7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.700439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdeaf3f-9253-4aee-b88a-1f97513da7f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.701150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdeaf3f-9253-4aee-b88a-1f97513da7f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:28.702579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdeaf3f-9253-4aee-b88a-1f97513da7f3 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-bcdeaf3f-9253-4aee-b88a-1f97513da7f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:28.715814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:28.717101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:28.718646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 493/1003] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:28.723270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0934c-aa79-4a54-8445-81a27af5683f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:28.836066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0934c-aa79-4a54-8445-81a27af5683f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:28.872842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27226e-3832-425c-b601-5fc207944b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:28.873502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27226e-3832-425c-b601-5fc207944b80 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:28.873781 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27226e-3832-425c-b601-5fc207944b80 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:28.874055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27226e-3832-425c-b601-5fc207944b80 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:28.874755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27226e-3832-425c-b601-5fc207944b80 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:28.875114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27226e-3832-425c-b601-5fc207944b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:28.876487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27226e-3832-425c-b601-5fc207944b80 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:28.881385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 511/1004] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:28.887745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeaf3f-9253-4aee-b88a-1f97513da7f3 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:28.993863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdeaf3f-9253-4aee-b88a-1f97513da7f3 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:29.029502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96e93c-3892-41e4-bd40-c3d73564258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:29.030175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e93c-3892-41e4-bd40-c3d73564258c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:29.030463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e93c-3892-41e4-bd40-c3d73564258c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:29.030745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96e93c-3892-41e4-bd40-c3d73564258c None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:29.031501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e93c-3892-41e4-bd40-c3d73564258c None admin] RBAC: Adding query filter params (type=compute) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:29.031820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e93c-3892-41e4-bd40-c3d73564258c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:29.033198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96e93c-3892-41e4-bd40-c3d73564258c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:29.038429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 494/1005] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:29.044587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27226e-3832-425c-b601-5fc207944b80 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:29.071399 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:29.148971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27226e-3832-425c-b601-5fc207944b80 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:29.183615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6efb7-f1d9-4e82-b8e0-38104dafa06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:29.186222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6efb7-f1d9-4e82-b8e0-38104dafa06f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:29.186222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6efb7-f1d9-4e82-b8e0-38104dafa06f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:29.186222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6efb7-f1d9-4e82-b8e0-38104dafa06f None admin] PATH_INFO: `/v3/endpoints` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:29.186441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6efb7-f1d9-4e82-b8e0-38104dafa06f None admin] RBAC: Adding query filter params (interface=public, service_id=ccd1974d9e8745e695b2a83fe9fa3203, region_id=RegionOne) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:29.186659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6efb7-f1d9-4e82-b8e0-38104dafa06f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:29.188049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6efb7-f1d9-4e82-b8e0-38104dafa06f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:29.197775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 512/1006] 10.222.0.42 () {56 vars in 1251 bytes} [Fri May 27 13:40:29 2022] GET /identity/v3/endpoints?service_id=ccd1974d9e8745e695b2a83fe9fa3203&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:29.199073 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96e93c-3892-41e4-bd40-c3d73564258c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:29.258078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:29.303442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96e93c-3892-41e4-bd40-c3d73564258c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:29.337278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7028fb4-c477-4c31-af40-714f8e58d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:29.337947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028fb4-c477-4c31-af40-714f8e58d758 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:29.338234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028fb4-c477-4c31-af40-714f8e58d758 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:29.338512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028fb4-c477-4c31-af40-714f8e58d758 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:29.339221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7028fb4-c477-4c31-af40-714f8e58d758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:29.341373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7028fb4-c477-4c31-af40-714f8e58d758 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:29.351352 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 495/1007] 10.222.0.42 () {56 vars in 1087 bytes} [Fri May 27 13:40:29 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 13:40:30.675693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f604142-39f2-459c-a0f3-8cdf6ca1a599 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:30.676177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f604142-39f2-459c-a0f3-8cdf6ca1a599 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:30.676294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f604142-39f2-459c-a0f3-8cdf6ca1a599 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:30.677719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 513/1008] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:30.683477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886d2ba-69fd-4ddd-bbd3-0c5bbd151448 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:30.684621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886d2ba-69fd-4ddd-bbd3-0c5bbd151448 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:30.684621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886d2ba-69fd-4ddd-bbd3-0c5bbd151448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:30.703646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-e886d2ba-69fd-4ddd-bbd3-0c5bbd151448 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:30.704862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e886d2ba-69fd-4ddd-bbd3-0c5bbd151448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:30.776369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 496/1009] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:30.799896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f604142-39f2-459c-a0f3-8cdf6ca1a599 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:30.888889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58192a7-0738-4fae-a956-31ce4c571796 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:30.889359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58192a7-0738-4fae-a956-31ce4c571796 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:30.889656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58192a7-0738-4fae-a956-31ce4c571796 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:30.890238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:30.891638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 497/1010] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:30.896911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c130cd-f912-4587-bed5-7493a7a561cb None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:30.903139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c130cd-f912-4587-bed5-7493a7a561cb None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:30.903139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c130cd-f912-4587-bed5-7493a7a561cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:30.906932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f604142-39f2-459c-a0f3-8cdf6ca1a599 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:30.915581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-23c130cd-f912-4587-bed5-7493a7a561cb None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:30.916796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-23c130cd-f912-4587-bed5-7493a7a561cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:30.948887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af5178-7b59-4f57-a59a-7557f3fd62fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:30.950526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af5178-7b59-4f57-a59a-7557f3fd62fc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:30.951092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af5178-7b59-4f57-a59a-7557f3fd62fc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:30.951600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af5178-7b59-4f57-a59a-7557f3fd62fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:30.952921 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af5178-7b59-4f57-a59a-7557f3fd62fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:30.955680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af5178-7b59-4f57-a59a-7557f3fd62fc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:30.961504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 514/1011] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:30.963405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af5178-7b59-4f57-a59a-7557f3fd62fc None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:30.966674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:30.990434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 498/1012] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:31.012932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c130cd-f912-4587-bed5-7493a7a561cb None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:31.071400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af5178-7b59-4f57-a59a-7557f3fd62fc None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:31.108341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e58615-cd5f-422f-a4d9-e99b4fd3469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:31.108999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e58615-cd5f-422f-a4d9-e99b4fd3469a None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:31.109284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e58615-cd5f-422f-a4d9-e99b4fd3469a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:31.109560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e58615-cd5f-422f-a4d9-e99b4fd3469a None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:31.110265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e58615-cd5f-422f-a4d9-e99b4fd3469a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:31.111720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e58615-cd5f-422f-a4d9-e99b4fd3469a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:31.118155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c130cd-f912-4587-bed5-7493a7a561cb None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:31.155385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4873e-59e0-4d50-9c8c-8e33f5ce9a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:31.156062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4873e-59e0-4d50-9c8c-8e33f5ce9a78 None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:31.156348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4873e-59e0-4d50-9c8c-8e33f5ce9a78 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:31.156628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4873e-59e0-4d50-9c8c-8e33f5ce9a78 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:31.157354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4873e-59e0-4d50-9c8c-8e33f5ce9a78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:31.158740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4873e-59e0-4d50-9c8c-8e33f5ce9a78 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:31.200811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 515/1013] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:40:30 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:40:31.263007 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 499/1014] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:40:31 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:40:31.614096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f18c0-21d5-4db7-9f2f-18d0e884b716 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:31.614494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f18c0-21d5-4db7-9f2f-18d0e884b716 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:31.614679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f18c0-21d5-4db7-9f2f-18d0e884b716 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:31.616238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 516/1015] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:31.621794 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e541f70-0063-46f6-8fdc-eb541b9d2e20 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:31.622163 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e541f70-0063-46f6-8fdc-eb541b9d2e20 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:31.622582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e541f70-0063-46f6-8fdc-eb541b9d2e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:31.640338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3e541f70-0063-46f6-8fdc-eb541b9d2e20 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:31.641518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3e541f70-0063-46f6-8fdc-eb541b9d2e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:31.678284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:31.722380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 500/1016] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:31 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:31.748541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f18c0-21d5-4db7-9f2f-18d0e884b716 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:31.758461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:31.853885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f18c0-21d5-4db7-9f2f-18d0e884b716 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:31.889460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884a95d-946d-4a2e-bf97-293fb39494ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:31.890542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884a95d-946d-4a2e-bf97-293fb39494ae None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:31.890991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884a95d-946d-4a2e-bf97-293fb39494ae None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:31.891427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884a95d-946d-4a2e-bf97-293fb39494ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:31.892233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884a95d-946d-4a2e-bf97-293fb39494ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:31.893748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884a95d-946d-4a2e-bf97-293fb39494ae None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-1884a95d-946d-4a2e-bf97-293fb39494ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:31.906443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:31.907619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:31.908523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 517/1017] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:31.915697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e541f70-0063-46f6-8fdc-eb541b9d2e20 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:32.022850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e541f70-0063-46f6-8fdc-eb541b9d2e20 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:32.060878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd275b4-d3d6-44e5-bf1e-9d094b8b8746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:32.061557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd275b4-d3d6-44e5-bf1e-9d094b8b8746 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:32.061847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd275b4-d3d6-44e5-bf1e-9d094b8b8746 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:32.062129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd275b4-d3d6-44e5-bf1e-9d094b8b8746 None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:32.062868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd275b4-d3d6-44e5-bf1e-9d094b8b8746 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:32.063206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd275b4-d3d6-44e5-bf1e-9d094b8b8746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:32.064592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd275b4-d3d6-44e5-bf1e-9d094b8b8746 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:32.074558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 501/1018] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:32.075912 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884a95d-946d-4a2e-bf97-293fb39494ae None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:32.148882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:32.180119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884a95d-946d-4a2e-bf97-293fb39494ae None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:32.213534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499901e-e74f-4bf6-8497-fa38f1217391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:32.214188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499901e-e74f-4bf6-8497-fa38f1217391 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:32.214477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499901e-e74f-4bf6-8497-fa38f1217391 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:32.214803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499901e-e74f-4bf6-8497-fa38f1217391 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:32.215568 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499901e-e74f-4bf6-8497-fa38f1217391 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:32.215867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499901e-e74f-4bf6-8497-fa38f1217391 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:32.217236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499901e-e74f-4bf6-8497-fa38f1217391 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:32.226587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 518/1019] 10.222.0.42 () {56 vars in 1112 bytes} [Fri May 27 13:40:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:32.228190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd275b4-d3d6-44e5-bf1e-9d094b8b8746 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:32.258519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:32.330754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd275b4-d3d6-44e5-bf1e-9d094b8b8746 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:32.366438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0102c61-ecb6-483f-a060-cb5b659b4d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:32.367155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102c61-ecb6-483f-a060-cb5b659b4d7d None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:32.367440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102c61-ecb6-483f-a060-cb5b659b4d7d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:32.367716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0102c61-ecb6-483f-a060-cb5b659b4d7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:32.368485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0102c61-ecb6-483f-a060-cb5b659b4d7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:32.369904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0102c61-ecb6-483f-a060-cb5b659b4d7d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:32.457658 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 502/1020] 10.222.0.42 () {60 vars in 1144 bytes} [Fri May 27 13:40:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:40:33.490896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1d2e-6401-433e-b356-2c1424c6ea04 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:33.491492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1d2e-6401-433e-b356-2c1424c6ea04 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:33.491492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee1d2e-6401-433e-b356-2c1424c6ea04 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:33.492990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 519/1021] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:33.498199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4460a25-4185-4178-b9d5-38a6f5387e38 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:33.498660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4460a25-4185-4178-b9d5-38a6f5387e38 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:33.498750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4460a25-4185-4178-b9d5-38a6f5387e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:33.517022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f4460a25-4185-4178-b9d5-38a6f5387e38 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:33.518204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f4460a25-4185-4178-b9d5-38a6f5387e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:33.522907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7462330-5b99-42b9-bf3c-f83a81d5fff5 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:33.523227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7462330-5b99-42b9-bf3c-f83a81d5fff5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:33.523504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7462330-5b99-42b9-bf3c-f83a81d5fff5 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:33.524989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 520/1022] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:33.530378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515728dd-358d-4ad5-851d-c8cea73372a7 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:33.530663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515728dd-358d-4ad5-851d-c8cea73372a7 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:33.530944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515728dd-358d-4ad5-851d-c8cea73372a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:33.548460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-515728dd-358d-4ad5-851d-c8cea73372a7 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:33.549633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-515728dd-358d-4ad5-851d-c8cea73372a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:33.595021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 503/1023] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:33.616198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 521/1024] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:33.619249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4460a25-4185-4178-b9d5-38a6f5387e38 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:33.630894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:33.638237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515728dd-358d-4ad5-851d-c8cea73372a7 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:33.713922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:33.732923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4460a25-4185-4178-b9d5-38a6f5387e38 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:33.753516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515728dd-358d-4ad5-851d-c8cea73372a7 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:33.771618 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c19549-a5e0-4067-9281-19d5a9efb255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:33.772418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19549-a5e0-4067-9281-19d5a9efb255 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:33.772701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19549-a5e0-4067-9281-19d5a9efb255 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:33.772978 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c19549-a5e0-4067-9281-19d5a9efb255 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:33.774153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c19549-a5e0-4067-9281-19d5a9efb255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:33.775630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c19549-a5e0-4067-9281-19d5a9efb255 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:33.778014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 504/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:33.783273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c19549-a5e0-4067-9281-19d5a9efb255 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:33.791192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b4a91-6691-4ffa-b631-08c41d5e06a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:33.792111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b4a91-6691-4ffa-b631-08c41d5e06a4 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:33.792394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b4a91-6691-4ffa-b631-08c41d5e06a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:33.792669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b4a91-6691-4ffa-b631-08c41d5e06a4 None admin] PATH_INFO: `/v3/services/image` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:33.793406 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b4a91-6691-4ffa-b631-08c41d5e06a4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:33.795025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b4a91-6691-4ffa-b631-08c41d5e06a4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ac7b4a91-6691-4ffa-b631-08c41d5e06a4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:33.807292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:33.808287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:33.809668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 522/1026] 10.222.0.42 () {56 vars in 1105 bytes} [Fri May 27 13:40:33 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:33.815086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b4a91-6691-4ffa-b631-08c41d5e06a4 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:33.873358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:33.895701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c19549-a5e0-4067-9281-19d5a9efb255 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:33.923179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b4a91-6691-4ffa-b631-08c41d5e06a4 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:33.932131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb0ab6-2839-413e-974c-0ab36639417f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:33.932810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0ab6-2839-413e-974c-0ab36639417f None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:33.933095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0ab6-2839-413e-974c-0ab36639417f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:33.933372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0ab6-2839-413e-974c-0ab36639417f None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:33.934249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb0ab6-2839-413e-974c-0ab36639417f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:33.935718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb0ab6-2839-413e-974c-0ab36639417f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:33.952128 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:33.959851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0dfa-cb01-439e-b8dc-e60427d825f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:33.963523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0dfa-cb01-439e-b8dc-e60427d825f8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:33.963523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0dfa-cb01-439e-b8dc-e60427d825f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:33.963523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0dfa-cb01-439e-b8dc-e60427d825f8 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:33.963523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a0dfa-cb01-439e-b8dc-e60427d825f8 None admin] RBAC: Adding query filter params (name=image) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:33.963523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a0dfa-cb01-439e-b8dc-e60427d825f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:33.963523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a0dfa-cb01-439e-b8dc-e60427d825f8 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:33.968800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 523/1027] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:33.974408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0dfa-cb01-439e-b8dc-e60427d825f8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:34.072418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0dfa-cb01-439e-b8dc-e60427d825f8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:34.107006 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 505/1028] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:40:33 2022] POST /identity/v3/users => generated 285 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:40:34.107240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacc787-87b5-4e57-b2ec-dc26ea6bec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:34.107240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacc787-87b5-4e57-b2ec-dc26ea6bec15 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:34.107546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacc787-87b5-4e57-b2ec-dc26ea6bec15 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:34.107913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacc787-87b5-4e57-b2ec-dc26ea6bec15 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:34.108592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacc787-87b5-4e57-b2ec-dc26ea6bec15 None admin] RBAC: Adding query filter params (type=image) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:34.108908 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacc787-87b5-4e57-b2ec-dc26ea6bec15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:34.110372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacc787-87b5-4e57-b2ec-dc26ea6bec15 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:34.116353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 524/1029] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:34.122571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb0ab6-2839-413e-974c-0ab36639417f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:34.238289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb0ab6-2839-413e-974c-0ab36639417f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:34.276353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce78286-1621-4963-9096-dd708f622ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:34.277028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78286-1621-4963-9096-dd708f622ae8 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:34.277309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78286-1621-4963-9096-dd708f622ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:34.277617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce78286-1621-4963-9096-dd708f622ae8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:34.278420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78286-1621-4963-9096-dd708f622ae8 None admin] RBAC: Adding query filter params (interface=public, service_id=c7b6901c94d34af89d575931437247a4, region_id=RegionOne) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:34.278726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78286-1621-4963-9096-dd708f622ae8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:34.280220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce78286-1621-4963-9096-dd708f622ae8 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:34.281955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:34.287929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 506/1030] 10.222.0.42 () {56 vars in 1251 bytes} [Fri May 27 13:40:34 2022] GET /identity/v3/endpoints?service_id=c7b6901c94d34af89d575931437247a4&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:34.294070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacc787-87b5-4e57-b2ec-dc26ea6bec15 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:34.360136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:34.405863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacc787-87b5-4e57-b2ec-dc26ea6bec15 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:34.442115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd3d4c-b238-4d52-9d0a-3564691fe4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:34.442786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd3d4c-b238-4d52-9d0a-3564691fe4ed None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:34.443101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd3d4c-b238-4d52-9d0a-3564691fe4ed None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:34.443382 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd3d4c-b238-4d52-9d0a-3564691fe4ed None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:34.444063 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd3d4c-b238-4d52-9d0a-3564691fe4ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:34.445440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd3d4c-b238-4d52-9d0a-3564691fe4ed None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:34.452346 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 525/1031] 10.222.0.42 () {56 vars in 1087 bytes} [Fri May 27 13:40:34 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 13:40:34.800354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5b602-b19a-4c01-9e59-b6fbabc315cf None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:34.800901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5b602-b19a-4c01-9e59-b6fbabc315cf None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:34.800901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5b602-b19a-4c01-9e59-b6fbabc315cf None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:34.802310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 507/1032] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:34.807683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f7d67-eb72-4177-8195-9f2f5a4a010f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:34.808076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f7d67-eb72-4177-8195-9f2f5a4a010f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:34.808322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f7d67-eb72-4177-8195-9f2f5a4a010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:34.825343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d22f7d67-eb72-4177-8195-9f2f5a4a010f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:34.827306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d22f7d67-eb72-4177-8195-9f2f5a4a010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:34.896760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 526/1033] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:34 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:34.921134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5b602-b19a-4c01-9e59-b6fbabc315cf None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:35.029190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5b602-b19a-4c01-9e59-b6fbabc315cf None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:35.062974 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8d5c5-a68a-405a-b006-b6019245ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:35.063783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8d5c5-a68a-405a-b006-b6019245ee0b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:35.064063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8d5c5-a68a-405a-b006-b6019245ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:35.064337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8d5c5-a68a-405a-b006-b6019245ee0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:35.075416 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8d5c5-a68a-405a-b006-b6019245ee0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-56b8d5c5-a68a-405a-b006-b6019245ee0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:35.083483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:35.084433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:35.085311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:35.087294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 508/1034] 10.222.0.42 () {56 vars in 1120 bytes} [Fri May 27 13:40:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:35.090960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f7d67-eb72-4177-8195-9f2f5a4a010f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:35.142741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:35.191411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f7d67-eb72-4177-8195-9f2f5a4a010f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:35.225540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2f9b7-5134-437b-adc7-414f889f3b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:35.226204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2f9b7-5134-437b-adc7-414f889f3b35 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:35.226484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2f9b7-5134-437b-adc7-414f889f3b35 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:35.226755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2f9b7-5134-437b-adc7-414f889f3b35 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:35.227532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2f9b7-5134-437b-adc7-414f889f3b35 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:35.227838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2f9b7-5134-437b-adc7-414f889f3b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:35.229239 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2f9b7-5134-437b-adc7-414f889f3b35 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:35.238380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 527/1035] 10.222.0.42 () {56 vars in 1115 bytes} [Fri May 27 13:40:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:35.243958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8d5c5-a68a-405a-b006-b6019245ee0b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:35.305320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:35.349791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8d5c5-a68a-405a-b006-b6019245ee0b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:35.385165 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fac6b-92fc-453d-9302-25b09faee8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:35.386171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fac6b-92fc-453d-9302-25b09faee8bd None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:35.386625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fac6b-92fc-453d-9302-25b09faee8bd None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:35.387266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fac6b-92fc-453d-9302-25b09faee8bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:35.397527 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fac6b-92fc-453d-9302-25b09faee8bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:35.399191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fac6b-92fc-453d-9302-25b09faee8bd None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-7e1fac6b-92fc-453d-9302-25b09faee8bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:35.417916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:35.419005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:35.419899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:35.419899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:35.419899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:35.419899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:35.423105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 509/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:35.426161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2f9b7-5134-437b-adc7-414f889f3b35 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:35.533179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2f9b7-5134-437b-adc7-414f889f3b35 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:35.548435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:35.570389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff3fa8-6cf5-4d26-8b17-889ce319bbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:35.571013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff3fa8-6cf5-4d26-8b17-889ce319bbbd None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:35.571282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff3fa8-6cf5-4d26-8b17-889ce319bbbd None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:35.571552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff3fa8-6cf5-4d26-8b17-889ce319bbbd None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:35.572285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff3fa8-6cf5-4d26-8b17-889ce319bbbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:35.572591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff3fa8-6cf5-4d26-8b17-889ce319bbbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:35.574009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff3fa8-6cf5-4d26-8b17-889ce319bbbd None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:35.588033 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 528/1037] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:35.593101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fac6b-92fc-453d-9302-25b09faee8bd None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:35.706932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fac6b-92fc-453d-9302-25b09faee8bd None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:35.719315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:35.742849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3425da-d787-47a9-bab6-9fd306b59bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:35.743673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3425da-d787-47a9-bab6-9fd306b59bbc None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:35.743960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3425da-d787-47a9-bab6-9fd306b59bbc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:35.744239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3425da-d787-47a9-bab6-9fd306b59bbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:35.751876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3425da-d787-47a9-bab6-9fd306b59bbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:35.753333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3425da-d787-47a9-bab6-9fd306b59bbc None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-ee3425da-d787-47a9-bab6-9fd306b59bbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:35.769325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:35.770370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:35.776353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 510/1038] 10.222.0.42 () {56 vars in 1093 bytes} [Fri May 27 13:40:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:35.779332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff3fa8-6cf5-4d26-8b17-889ce319bbbd None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:35.886425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff3fa8-6cf5-4d26-8b17-889ce319bbbd None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:35.921088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b75a7-9db1-4729-8841-588678d0cf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:35.921754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b75a7-9db1-4729-8841-588678d0cf0f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:35.922034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b75a7-9db1-4729-8841-588678d0cf0f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:35.922306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b75a7-9db1-4729-8841-588678d0cf0f None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:35.923367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b75a7-9db1-4729-8841-588678d0cf0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:35.923720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b75a7-9db1-4729-8841-588678d0cf0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:35.925401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b75a7-9db1-4729-8841-588678d0cf0f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:35.947201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 529/1039] 10.222.0.42 () {56 vars in 1133 bytes} [Fri May 27 13:40:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:35.948415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3425da-d787-47a9-bab6-9fd306b59bbc None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:36.055619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3425da-d787-47a9-bab6-9fd306b59bbc None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:36.091984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b15e5b-cede-4620-9c16-9d5a5957e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:36.092684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b15e5b-cede-4620-9c16-9d5a5957e080 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:36.092959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b15e5b-cede-4620-9c16-9d5a5957e080 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:36.093212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b15e5b-cede-4620-9c16-9d5a5957e080 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:36.132425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:36.161281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b15e5b-cede-4620-9c16-9d5a5957e080 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:36.162707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b15e5b-cede-4620-9c16-9d5a5957e080 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:36.267638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 511/1040] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:35 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:40:36.269571 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b75a7-9db1-4729-8841-588678d0cf0f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:36.301995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:36.373585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b75a7-9db1-4729-8841-588678d0cf0f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:36.410467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a4dc9-a809-4166-9569-b1f6ccd0fd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:36.411460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a4dc9-a809-4166-9569-b1f6ccd0fd40 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:36.411683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a4dc9-a809-4166-9569-b1f6ccd0fd40 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:36.411950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a4dc9-a809-4166-9569-b1f6ccd0fd40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:36.423189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a4dc9-a809-4166-9569-b1f6ccd0fd40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:36.424617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a4dc9-a809-4166-9569-b1f6ccd0fd40 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-f16a4dc9-a809-4166-9569-b1f6ccd0fd40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:36.442144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:36.443339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:36.444241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:36.444241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:36.444241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:36.444241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:36.447297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 530/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:36.449876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b15e5b-cede-4620-9c16-9d5a5957e080 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:36.522321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:36.555052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b15e5b-cede-4620-9c16-9d5a5957e080 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:36.589365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29363c9-cc17-4b49-8ae3-d401d07d8798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:36.590128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29363c9-cc17-4b49-8ae3-d401d07d8798 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:36.590411 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29363c9-cc17-4b49-8ae3-d401d07d8798 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:36.590685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29363c9-cc17-4b49-8ae3-d401d07d8798 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:36.591438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29363c9-cc17-4b49-8ae3-d401d07d8798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:36.591747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29363c9-cc17-4b49-8ae3-d401d07d8798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:36.593119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29363c9-cc17-4b49-8ae3-d401d07d8798 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:36.609558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 512/1042] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:36.611404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a4dc9-a809-4166-9569-b1f6ccd0fd40 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:36.673674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99eae7e-fe97-4a3e-8b99-282294b8272c None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:36.674184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99eae7e-fe97-4a3e-8b99-282294b8272c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:36.674681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99eae7e-fe97-4a3e-8b99-282294b8272c None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:36.677481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 513/1043] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:36.682771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637b82-cfc9-4c68-b52b-cc4a640af669 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:36.683092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637b82-cfc9-4c68-b52b-cc4a640af669 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:36.683376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c637b82-cfc9-4c68-b52b-cc4a640af669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:36.701608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4c637b82-cfc9-4c68-b52b-cc4a640af669 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:36.702797 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4c637b82-cfc9-4c68-b52b-cc4a640af669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:36.712901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:36.732771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a4dc9-a809-4166-9569-b1f6ccd0fd40 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:36.773687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ee24d-f2ae-4c5c-b473-e47c858e87cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:36.774487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ee24d-f2ae-4c5c-b473-e47c858e87cd None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:36.774765 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ee24d-f2ae-4c5c-b473-e47c858e87cd None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:36.775064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ee24d-f2ae-4c5c-b473-e47c858e87cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:36.783007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ee24d-f2ae-4c5c-b473-e47c858e87cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:36.783891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3ee24d-f2ae-4c5c-b473-e47c858e87cd None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:36.787286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 514/1044] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-cb3ee24d-f2ae-4c5c-b473-e47c858e87cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:36.798366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:36.799302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:36.800491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:36.800491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:36.800491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:36.800491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:36.800491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:36.800491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:36.800491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:36.800491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:36.803527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 531/1045] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:36.804239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637b82-cfc9-4c68-b52b-cc4a640af669 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:36.805493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ee24d-f2ae-4c5c-b473-e47c858e87cd None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:36.868923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:36.911919 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c637b82-cfc9-4c68-b52b-cc4a640af669 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:36.914239 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ee24d-f2ae-4c5c-b473-e47c858e87cd None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:36.949920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5cf39-6e98-4eef-bf5c-7aff797d2f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:36.950490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc05cd-3239-47ba-af09-34ed34cd5bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:36.950955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5cf39-6e98-4eef-bf5c-7aff797d2f0a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:36.950955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5cf39-6e98-4eef-bf5c-7aff797d2f0a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:36.951141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5cf39-6e98-4eef-bf5c-7aff797d2f0a None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:36.951312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc05cd-3239-47ba-af09-34ed34cd5bcc None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:36.951591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc05cd-3239-47ba-af09-34ed34cd5bcc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:36.951862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc05cd-3239-47ba-af09-34ed34cd5bcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:36.951954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5cf39-6e98-4eef-bf5c-7aff797d2f0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:36.952200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5cf39-6e98-4eef-bf5c-7aff797d2f0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:36.953615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5cf39-6e98-4eef-bf5c-7aff797d2f0a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:36.962095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc05cd-3239-47ba-af09-34ed34cd5bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:36.966162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 532/1046] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:36.967423 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf3ad1-343a-4092-a506-22e4185138a7 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:36.967707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf3ad1-343a-4092-a506-22e4185138a7 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:36.967978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf3ad1-343a-4092-a506-22e4185138a7 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:36.969407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 533/1047] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-fadc05cd-3239-47ba-af09-34ed34cd5bcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:36.970669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:36.971595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:36.972439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 515/1048] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:36.973148 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf3ad1-343a-4092-a506-22e4185138a7 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:36.974489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b6a67-0bcf-4ee5-ade0-99e70b393270 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:36.974781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b6a67-0bcf-4ee5-ade0-99e70b393270 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:36.975088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b6a67-0bcf-4ee5-ade0-99e70b393270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:36.977782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:36.992178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-692b6a67-0bcf-4ee5-ade0-99e70b393270 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:36.993393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-692b6a67-0bcf-4ee5-ade0-99e70b393270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:37.058792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 516/1049] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:37.059684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b6a67-0bcf-4ee5-ade0-99e70b393270 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:37.078201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf3ad1-343a-4092-a506-22e4185138a7 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:37.109609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:37.113875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071c86-4fc5-4d30-be93-c53b281b11a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:37.119034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071c86-4fc5-4d30-be93-c53b281b11a9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:37.119034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071c86-4fc5-4d30-be93-c53b281b11a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:37.119034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071c86-4fc5-4d30-be93-c53b281b11a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:37.119034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8071c86-4fc5-4d30-be93-c53b281b11a9 None admin] RBAC: Adding query filter params (role.id=d88071d05f2e438dbbe25f0bcd08b9a4, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=9a1644fa5cd3499d9d6ad057067255e9) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:37.119034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8071c86-4fc5-4d30-be93-c53b281b11a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:37.119034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8071c86-4fc5-4d30-be93-c53b281b11a9 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:37.123181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 534/1050] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:36 2022] GET /identity/v3/role_assignments?user.id=9a1644fa5cd3499d9d6ad057067255e9&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=d88071d05f2e438dbbe25f0bcd08b9a4 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:37.123963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071c86-4fc5-4d30-be93-c53b281b11a9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:37.166607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b6a67-0bcf-4ee5-ade0-99e70b393270 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:37.200843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:37.207334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a931c5-9c55-4139-8874-ec90bf1cefc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:37.208022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a931c5-9c55-4139-8874-ec90bf1cefc9 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:37.208307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a931c5-9c55-4139-8874-ec90bf1cefc9 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:37.208654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a931c5-9c55-4139-8874-ec90bf1cefc9 None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:37.209435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a931c5-9c55-4139-8874-ec90bf1cefc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:37.209743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a931c5-9c55-4139-8874-ec90bf1cefc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:37.211194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a931c5-9c55-4139-8874-ec90bf1cefc9 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:37.226642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 517/1051] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:40:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:37.228779 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a931c5-9c55-4139-8874-ec90bf1cefc9 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:37.242951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071c86-4fc5-4d30-be93-c53b281b11a9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:37.284912 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8bde2-7101-439b-913a-d6772f1af43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:37.285719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8bde2-7101-439b-913a-d6772f1af43b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:37.286004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8bde2-7101-439b-913a-d6772f1af43b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:37.286280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8bde2-7101-439b-913a-d6772f1af43b None admin] PATH_INFO: `/v3/services/image` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:37.286945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8bde2-7101-439b-913a-d6772f1af43b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:37.288365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8bde2-7101-439b-913a-d6772f1af43b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-13e8bde2-7101-439b-913a-d6772f1af43b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:37.301924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:37.303151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:37.304022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 535/1052] 10.222.0.42 () {56 vars in 1105 bytes} [Fri May 27 13:40:37 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:37.309688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8bde2-7101-439b-913a-d6772f1af43b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:37.351758 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a931c5-9c55-4139-8874-ec90bf1cefc9 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:37.365572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:37.389449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c3c2-6067-4a0e-8450-1dd6e97a336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:37.390364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c3c2-6067-4a0e-8450-1dd6e97a336f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:37.390645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c3c2-6067-4a0e-8450-1dd6e97a336f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:37.390926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85c3c2-6067-4a0e-8450-1dd6e97a336f None admin] PATH_INFO: `/v3/users/922ef54f8d6c457cbc64d1d4caba5c07` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:37.407637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85c3c2-6067-4a0e-8450-1dd6e97a336f None admin] RBAC: Authorizing `identity:get_user(user_id=922ef54f8d6c457cbc64d1d4caba5c07)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:37.409385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85c3c2-6067-4a0e-8450-1dd6e97a336f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:37.416568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 518/1053] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:40:37 2022] GET /identity/v3/users/922ef54f8d6c457cbc64d1d4caba5c07 => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:37.418738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c3c2-6067-4a0e-8450-1dd6e97a336f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:37.420620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8bde2-7101-439b-913a-d6772f1af43b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:37.451757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:37.457495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92dcf-7bf5-476b-907b-f63cbf419cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:37.458261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92dcf-7bf5-476b-907b-f63cbf419cbc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:37.462631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92dcf-7bf5-476b-907b-f63cbf419cbc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:37.462631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d92dcf-7bf5-476b-907b-f63cbf419cbc None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:37.462631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d92dcf-7bf5-476b-907b-f63cbf419cbc None admin] RBAC: Adding query filter params (name=image) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:37.462631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d92dcf-7bf5-476b-907b-f63cbf419cbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:37.462631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d92dcf-7bf5-476b-907b-f63cbf419cbc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:37.466800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 536/1054] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:37.472310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92dcf-7bf5-476b-907b-f63cbf419cbc None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:37.531594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85c3c2-6067-4a0e-8450-1dd6e97a336f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:37.570069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3448d3-3b5f-429d-9cee-c7e5f57ab342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:37.570993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3448d3-3b5f-429d-9cee-c7e5f57ab342 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:37.571384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3448d3-3b5f-429d-9cee-c7e5f57ab342 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:37.571852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3448d3-3b5f-429d-9cee-c7e5f57ab342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:37.574340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d92dcf-7bf5-476b-907b-f63cbf419cbc None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:37.609557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811174b0-ca51-4c61-8a86-378d72a12a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:37.610227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811174b0-ca51-4c61-8a86-378d72a12a22 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:37.610508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811174b0-ca51-4c61-8a86-378d72a12a22 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:37.610782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811174b0-ca51-4c61-8a86-378d72a12a22 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:37.611513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811174b0-ca51-4c61-8a86-378d72a12a22 None admin] RBAC: Adding query filter params (type=image) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:37.611818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811174b0-ca51-4c61-8a86-378d72a12a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:37.613171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811174b0-ca51-4c61-8a86-378d72a12a22 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:37.615099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:37.626044 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 537/1055] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:37.627730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811174b0-ca51-4c61-8a86-378d72a12a22 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:37.653998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3448d3-3b5f-429d-9cee-c7e5f57ab342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:37.655499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3448d3-3b5f-429d-9cee-c7e5f57ab342 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:37.696222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:37.739429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811174b0-ca51-4c61-8a86-378d72a12a22 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:37.767687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 519/1056] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:40:37.773199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3448d3-3b5f-429d-9cee-c7e5f57ab342 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:37.780379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042fc33-5484-42e0-885e-7a89e390d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:37.781053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042fc33-5484-42e0-885e-7a89e390d1d7 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:37.781332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042fc33-5484-42e0-885e-7a89e390d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:37.781605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042fc33-5484-42e0-885e-7a89e390d1d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:37.782345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042fc33-5484-42e0-885e-7a89e390d1d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:37.783728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042fc33-5484-42e0-885e-7a89e390d1d7 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:37.845826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:37.876331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3448d3-3b5f-429d-9cee-c7e5f57ab342 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:37.885698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 538/1057] 10.222.0.42 () {60 vars in 1144 bytes} [Fri May 27 13:40:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:40:37.920264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e1bf-f481-4356-a81f-d644941bdde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:37.921141 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e1bf-f481-4356-a81f-d644941bdde4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:37.921424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e1bf-f481-4356-a81f-d644941bdde4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:37.921699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e1bf-f481-4356-a81f-d644941bdde4 None admin] PATH_INFO: `/v3/projects/d34c64691f4641c59a3169388f252156` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:37.923020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e1bf-f481-4356-a81f-d644941bdde4 None admin] RBAC: Authorizing `identity:get_project(project_id=d34c64691f4641c59a3169388f252156)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:37.924515 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e1bf-f481-4356-a81f-d644941bdde4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:37.926860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 520/1058] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:40:37 2022] GET /identity/v3/projects/d34c64691f4641c59a3169388f252156 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:37.933160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042fc33-5484-42e0-885e-7a89e390d1d7 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:38.045988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042fc33-5484-42e0-885e-7a89e390d1d7 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:38.062074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:38.085459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d98e8-5722-49c0-9334-13ee773f3823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:38.086111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d98e8-5722-49c0-9334-13ee773f3823 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:38.086395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d98e8-5722-49c0-9334-13ee773f3823 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:38.086664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d98e8-5722-49c0-9334-13ee773f3823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:38.087530 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d98e8-5722-49c0-9334-13ee773f3823 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=d34c64691f4641c59a3169388f252156, user.id=922ef54f8d6c457cbc64d1d4caba5c07) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:38.087843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d98e8-5722-49c0-9334-13ee773f3823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:38.089270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d98e8-5722-49c0-9334-13ee773f3823 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:38.099136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 539/1059] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:37 2022] GET /identity/v3/role_assignments?user.id=922ef54f8d6c457cbc64d1d4caba5c07&scope.project.id=d34c64691f4641c59a3169388f252156&role.id=3951cc86a51d416fafc5676d456e79ce => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:39.394220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127c77-ee2f-45ea-8df8-8c11f999ff6c None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:39.394783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127c77-ee2f-45ea-8df8-8c11f999ff6c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:39.394783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127c77-ee2f-45ea-8df8-8c11f999ff6c None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:39.396346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 521/1060] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:39.401379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6892fd9-ee0a-41b1-98cc-83b39b5cb928 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:39.401757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6892fd9-ee0a-41b1-98cc-83b39b5cb928 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:39.401933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6892fd9-ee0a-41b1-98cc-83b39b5cb928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:39.420237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a6892fd9-ee0a-41b1-98cc-83b39b5cb928 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:39.421438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a6892fd9-ee0a-41b1-98cc-83b39b5cb928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:39.489190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 540/1061] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:39.511644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127c77-ee2f-45ea-8df8-8c11f999ff6c None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:39.618305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127c77-ee2f-45ea-8df8-8c11f999ff6c None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:39.658050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f77d6-143b-4435-8f08-a2a288ac893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:39.658789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f77d6-143b-4435-8f08-a2a288ac893f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:39.659104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f77d6-143b-4435-8f08-a2a288ac893f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:39.659381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f77d6-143b-4435-8f08-a2a288ac893f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:39.661275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:39.676049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f77d6-143b-4435-8f08-a2a288ac893f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-506f77d6-143b-4435-8f08-a2a288ac893f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:39.684990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:39.685920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:39.686830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 522/1062] 10.222.0.42 () {56 vars in 1120 bytes} [Fri May 27 13:40:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:39.694259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6892fd9-ee0a-41b1-98cc-83b39b5cb928 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:39.796172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6892fd9-ee0a-41b1-98cc-83b39b5cb928 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:39.805987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:39.831261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813a35d-5594-41d8-88b6-9c389eb86e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:39.831932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813a35d-5594-41d8-88b6-9c389eb86e20 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:39.832216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813a35d-5594-41d8-88b6-9c389eb86e20 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:39.832486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813a35d-5594-41d8-88b6-9c389eb86e20 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:39.833227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813a35d-5594-41d8-88b6-9c389eb86e20 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:39.833526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813a35d-5594-41d8-88b6-9c389eb86e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:39.834874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813a35d-5594-41d8-88b6-9c389eb86e20 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:39.844110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 541/1063] 10.222.0.42 () {56 vars in 1115 bytes} [Fri May 27 13:40:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:39.848994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f77d6-143b-4435-8f08-a2a288ac893f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:39.957957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f77d6-143b-4435-8f08-a2a288ac893f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:39.993588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a41e17a-9f5a-4cd3-9428-a0871b27c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:39.994385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41e17a-9f5a-4cd3-9428-a0871b27c349 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:39.994672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41e17a-9f5a-4cd3-9428-a0871b27c349 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:39.994950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a41e17a-9f5a-4cd3-9428-a0871b27c349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.005951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41e17a-9f5a-4cd3-9428-a0871b27c349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:40.007435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a41e17a-9f5a-4cd3-9428-a0871b27c349 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-4a41e17a-9f5a-4cd3-9428-a0871b27c349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:40.024520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:40.025465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:40.026345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:40.026345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:40.026345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:40.026345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:40.026345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 523/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:40.032917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813a35d-5594-41d8-88b6-9c389eb86e20 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:40.134175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b62f6-f062-4b79-b378-6789dacfa8f5 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.134175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b62f6-f062-4b79-b378-6789dacfa8f5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.134175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b62f6-f062-4b79-b378-6789dacfa8f5 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.134175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 524/1065] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:40:40.140076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314b53f-3ce6-481c-a033-d5518888f02a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.140391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314b53f-3ce6-481c-a033-d5518888f02a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.140634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314b53f-3ce6-481c-a033-d5518888f02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.141125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813a35d-5594-41d8-88b6-9c389eb86e20 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:40.158339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8314b53f-3ce6-481c-a033-d5518888f02a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:40.159551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8314b53f-3ce6-481c-a033-d5518888f02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:40.180850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15843a3-07fb-4c1b-aa0f-a495fe01ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:40.181870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15843a3-07fb-4c1b-aa0f-a495fe01ac3b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.182424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15843a3-07fb-4c1b-aa0f-a495fe01ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.183062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15843a3-07fb-4c1b-aa0f-a495fe01ac3b None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.183956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15843a3-07fb-4c1b-aa0f-a495fe01ac3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:40.188131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15843a3-07fb-4c1b-aa0f-a495fe01ac3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:40.188131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15843a3-07fb-4c1b-aa0f-a495fe01ac3b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:40.204270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 542/1066] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:40.205611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15843a3-07fb-4c1b-aa0f-a495fe01ac3b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:40.207607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:40.233203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 525/1067] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:40.238228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:40.255850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314b53f-3ce6-481c-a033-d5518888f02a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:40.312458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15843a3-07fb-4c1b-aa0f-a495fe01ac3b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:40.380352 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314b53f-3ce6-481c-a033-d5518888f02a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:40.384802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33f93e-f0a6-484a-84c7-3fd8464adb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:40.385583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33f93e-f0a6-484a-84c7-3fd8464adb36 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.385916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33f93e-f0a6-484a-84c7-3fd8464adb36 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.386239 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33f93e-f0a6-484a-84c7-3fd8464adb36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.394791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33f93e-f0a6-484a-84c7-3fd8464adb36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:40.396255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33f93e-f0a6-484a-84c7-3fd8464adb36 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-2e33f93e-f0a6-484a-84c7-3fd8464adb36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:40.410942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:40.415118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 543/1068] 10.222.0.42 () {56 vars in 1093 bytes} [Fri May 27 13:40:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed2c9-44c8-42d1-abdc-b53bd213cb04 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.416075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed2c9-44c8-42d1-abdc-b53bd213cb04 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.416767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed2c9-44c8-42d1-abdc-b53bd213cb04 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.416767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 544/1069] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:40.417782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daed2c9-44c8-42d1-abdc-b53bd213cb04 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:40.419983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c09f-1eee-48d0-92f5-2b51732796e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:40.420589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c09f-1eee-48d0-92f5-2b51732796e6 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.420880 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c09f-1eee-48d0-92f5-2b51732796e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.421145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c09f-1eee-48d0-92f5-2b51732796e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.542822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:40.565830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82c09f-1eee-48d0-92f5-2b51732796e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:40.567342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82c09f-1eee-48d0-92f5-2b51732796e6 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:40.590500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:40.601222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daed2c9-44c8-42d1-abdc-b53bd213cb04 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:40.636110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1874dd-2a07-43f1-bde9-e799bd6635ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:40.636844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1874dd-2a07-43f1-bde9-e799bd6635ac None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.637170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1874dd-2a07-43f1-bde9-e799bd6635ac None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.637510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1874dd-2a07-43f1-bde9-e799bd6635ac None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.638349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1874dd-2a07-43f1-bde9-e799bd6635ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:40.638654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1874dd-2a07-43f1-bde9-e799bd6635ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:40.640110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1874dd-2a07-43f1-bde9-e799bd6635ac None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:40.658553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 545/1070] 10.222.0.42 () {56 vars in 1133 bytes} [Fri May 27 13:40:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:40.660138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d979f-d157-4c3f-a8c6-fc471ba3b789 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.660609 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d979f-d157-4c3f-a8c6-fc471ba3b789 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.661097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d979f-d157-4c3f-a8c6-fc471ba3b789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.669585 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 526/1071] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 13:40:40.670651 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c09f-1eee-48d0-92f5-2b51732796e6 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:40.679833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-bb7d979f-d157-4c3f-a8c6-fc471ba3b789 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:40.681024 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bb7d979f-d157-4c3f-a8c6-fc471ba3b789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:40.747345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 546/1072] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:40.747542 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:40.747955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d979f-d157-4c3f-a8c6-fc471ba3b789 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:40.771137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c09f-1eee-48d0-92f5-2b51732796e6 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:40.807842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd7e60-c033-4c43-98aa-9b9b90c07fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:40.809115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd7e60-c033-4c43-98aa-9b9b90c07fdf None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.809581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd7e60-c033-4c43-98aa-9b9b90c07fdf None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.809953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd7e60-c033-4c43-98aa-9b9b90c07fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.820101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd7e60-c033-4c43-98aa-9b9b90c07fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:40.821558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd7e60-c033-4c43-98aa-9b9b90c07fdf None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:40.832367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-ccfd7e60-c033-4c43-98aa-9b9b90c07fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:40.839643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:40.843409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:40.844517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:40.844517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:40.844517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:40.844517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:40.844517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 527/1073] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:40.844517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd7e60-c033-4c43-98aa-9b9b90c07fdf None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:40.857184 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d979f-d157-4c3f-a8c6-fc471ba3b789 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:40.894675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c746cb4-0b6e-4d68-904a-de74bd5e68cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:40.895737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c746cb4-0b6e-4d68-904a-de74bd5e68cc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.896014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c746cb4-0b6e-4d68-904a-de74bd5e68cc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.896284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c746cb4-0b6e-4d68-904a-de74bd5e68cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.907099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c746cb4-0b6e-4d68-904a-de74bd5e68cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:40.908550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c746cb4-0b6e-4d68-904a-de74bd5e68cc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-5c746cb4-0b6e-4d68-904a-de74bd5e68cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:40.926469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:40.927420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:40.928294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:40.928294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:40.928294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:40.928294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:40.928294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 547/1074] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:40.928578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c746cb4-0b6e-4d68-904a-de74bd5e68cc None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:40.952665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd7e60-c033-4c43-98aa-9b9b90c07fdf None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:40.978646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:40.986660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31bbae-571c-41fa-be04-3328a9b7b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:40.987501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31bbae-571c-41fa-be04-3328a9b7b89d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:40.987787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31bbae-571c-41fa-be04-3328a9b7b89d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:40.988062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31bbae-571c-41fa-be04-3328a9b7b89d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:40.998130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31bbae-571c-41fa-be04-3328a9b7b89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-3e31bbae-571c-41fa-be04-3328a9b7b89d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:41.005980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:41.006961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:41.007849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:41.013346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 528/1075] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:41.014164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31bbae-571c-41fa-be04-3328a9b7b89d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:41.036195 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c746cb4-0b6e-4d68-904a-de74bd5e68cc None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:41.065529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:41.071354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f0e0b-084a-4be1-b783-1e70859ba722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:41.072008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f0e0b-084a-4be1-b783-1e70859ba722 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:41.072286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f0e0b-084a-4be1-b783-1e70859ba722 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:41.072560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f0e0b-084a-4be1-b783-1e70859ba722 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:41.073268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f0e0b-084a-4be1-b783-1e70859ba722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:41.073566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f0e0b-084a-4be1-b783-1e70859ba722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:41.075464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f0e0b-084a-4be1-b783-1e70859ba722 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:41.086274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 548/1076] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:41.087093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f0e0b-084a-4be1-b783-1e70859ba722 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:41.115198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31bbae-571c-41fa-be04-3328a9b7b89d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:41.148858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3a736-8501-4502-ad2c-5ce2e7848c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:41.149508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3a736-8501-4502-ad2c-5ce2e7848c47 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:41.149796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3a736-8501-4502-ad2c-5ce2e7848c47 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:41.150064 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3a736-8501-4502-ad2c-5ce2e7848c47 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:41.150781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3a736-8501-4502-ad2c-5ce2e7848c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:41.151111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3a736-8501-4502-ad2c-5ce2e7848c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:41.153233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3a736-8501-4502-ad2c-5ce2e7848c47 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:41.165477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 529/1077] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:41.166380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3a736-8501-4502-ad2c-5ce2e7848c47 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:41.192649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f0e0b-084a-4be1-b783-1e70859ba722 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:41.224929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:41.232971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb5961-435a-4242-86b4-553783197ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:41.233657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb5961-435a-4242-86b4-553783197ef0 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:41.233935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb5961-435a-4242-86b4-553783197ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:41.234207 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb5961-435a-4242-86b4-553783197ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:41.237440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb5961-435a-4242-86b4-553783197ef0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:41.237440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb5961-435a-4242-86b4-553783197ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:41.237440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb5961-435a-4242-86b4-553783197ef0 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:41.245873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 549/1078] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:41.252157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb5961-435a-4242-86b4-553783197ef0 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:41.288464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3a736-8501-4502-ad2c-5ce2e7848c47 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:41.309638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:41.328822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0e112-4b0e-4db0-be13-49ddcb58a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:41.328822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0e112-4b0e-4db0-be13-49ddcb58a07e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:41.328822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0e112-4b0e-4db0-be13-49ddcb58a07e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:41.328822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0e112-4b0e-4db0-be13-49ddcb58a07e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:41.336413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0e112-4b0e-4db0-be13-49ddcb58a07e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:41.337936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0e112-4b0e-4db0-be13-49ddcb58a07e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-8cd0e112-4b0e-4db0-be13-49ddcb58a07e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:41.352818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:41.353818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:41.354700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:41.354700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:41.354700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:41.354700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:41.354700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:41.354700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:41.354700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:41.354700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:41.354700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 530/1079] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:41.359852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0e112-4b0e-4db0-be13-49ddcb58a07e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:41.366549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb5961-435a-4242-86b4-553783197ef0 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:41.406150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63512c5f-99da-468c-a0ec-3f65c887df3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:41.407213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63512c5f-99da-468c-a0ec-3f65c887df3a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:41.407409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63512c5f-99da-468c-a0ec-3f65c887df3a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:41.407642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63512c5f-99da-468c-a0ec-3f65c887df3a None admin] PATH_INFO: `/v3/users/922ef54f8d6c457cbc64d1d4caba5c07` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:41.408936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63512c5f-99da-468c-a0ec-3f65c887df3a None admin] RBAC: Authorizing `identity:get_user(user_id=922ef54f8d6c457cbc64d1d4caba5c07)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:41.410385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63512c5f-99da-468c-a0ec-3f65c887df3a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:41.412657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 550/1080] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:40:41 2022] GET /identity/v3/users/922ef54f8d6c457cbc64d1d4caba5c07 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:41.418087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63512c5f-99da-468c-a0ec-3f65c887df3a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:41.491019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0e112-4b0e-4db0-be13-49ddcb58a07e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:41.500003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:41.524752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d15663-6754-4b4c-8f5d-214c131f59fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:41.525410 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d15663-6754-4b4c-8f5d-214c131f59fa None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:41.525691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d15663-6754-4b4c-8f5d-214c131f59fa None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:41.525964 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d15663-6754-4b4c-8f5d-214c131f59fa None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:41.526744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d15663-6754-4b4c-8f5d-214c131f59fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:41.527080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d15663-6754-4b4c-8f5d-214c131f59fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:41.530179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d15663-6754-4b4c-8f5d-214c131f59fa None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:41.530909 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63512c5f-99da-468c-a0ec-3f65c887df3a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:41.546403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 531/1081] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:41.552508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d15663-6754-4b4c-8f5d-214c131f59fa None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:41.552846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:41.568197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b544703-70ea-4e37-9b46-606b879d5556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:41.569061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544703-70ea-4e37-9b46-606b879d5556 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:41.569347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544703-70ea-4e37-9b46-606b879d5556 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:41.569964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544703-70ea-4e37-9b46-606b879d5556 None admin] PATH_INFO: `/v3/projects/d34c64691f4641c59a3169388f252156` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:41.570794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b544703-70ea-4e37-9b46-606b879d5556 None admin] RBAC: Authorizing `identity:get_project(project_id=d34c64691f4641c59a3169388f252156)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:41.572268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b544703-70ea-4e37-9b46-606b879d5556 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:41.573972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 551/1082] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:40:41 2022] GET /identity/v3/projects/d34c64691f4641c59a3169388f252156 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:41.580647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b544703-70ea-4e37-9b46-606b879d5556 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:41.657773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d15663-6754-4b4c-8f5d-214c131f59fa None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:41.681405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b544703-70ea-4e37-9b46-606b879d5556 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:41.695136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a7f73-f82a-44e2-a658-48a5630b105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:41.696018 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a7f73-f82a-44e2-a658-48a5630b105b None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:41.696301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a7f73-f82a-44e2-a658-48a5630b105b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:41.696576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a7f73-f82a-44e2-a658-48a5630b105b None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/9a1644fa5cd3499d9d6ad057067255e9/roles/d88071d05f2e438dbbe25f0bcd08b9a4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:41.698829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a7f73-f82a-44e2-a658-48a5630b105b None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=9a1644fa5cd3499d9d6ad057067255e9, role_id=d88071d05f2e438dbbe25f0bcd08b9a4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:41.700334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a7f73-f82a-44e2-a658-48a5630b105b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:41.716016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6686fd-c98d-460b-93c0-7a89b7e87753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:41.719409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6686fd-c98d-460b-93c0-7a89b7e87753 None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:41.719409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6686fd-c98d-460b-93c0-7a89b7e87753 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:41.719409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6686fd-c98d-460b-93c0-7a89b7e87753 None admin] PATH_INFO: `/v3/projects/d34c64691f4641c59a3169388f252156/users/922ef54f8d6c457cbc64d1d4caba5c07/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:41.719832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6686fd-c98d-460b-93c0-7a89b7e87753 None admin] RBAC: Authorizing `identity:create_grant(project_id=d34c64691f4641c59a3169388f252156, user_id=922ef54f8d6c457cbc64d1d4caba5c07, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:41.720862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6686fd-c98d-460b-93c0-7a89b7e87753 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:41.782016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 532/1083] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:40:41 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/9a1644fa5cd3499d9d6ad057067255e9/roles/d88071d05f2e438dbbe25f0bcd08b9a4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 13:40:41.787479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 552/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:40:41 2022] PUT /identity/v3/projects/d34c64691f4641c59a3169388f252156/users/922ef54f8d6c457cbc64d1d4caba5c07/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 13:40:44.005199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fa68b-6f04-43d0-abbf-b7ddf80c2b81 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.005764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d9bbe-9092-479e-a745-8c05e42162d7 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.005764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d9bbe-9092-479e-a745-8c05e42162d7 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.006233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fa68b-6f04-43d0-abbf-b7ddf80c2b81 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.006321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d9bbe-9092-479e-a745-8c05e42162d7 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.006404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fa68b-6f04-43d0-abbf-b7ddf80c2b81 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.007316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 553/1086] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:44.007425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 533/1086] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:44.012500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256c0be-28bc-4b89-9cd8-34332dc72c08 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.012735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f02d8-2183-49ed-a94a-3649a1ce0202 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.012835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256c0be-28bc-4b89-9cd8-34332dc72c08 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.013020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f02d8-2183-49ed-a94a-3649a1ce0202 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.013127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256c0be-28bc-4b89-9cd8-34332dc72c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.013296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f02d8-2183-49ed-a94a-3649a1ce0202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.030370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0256c0be-28bc-4b89-9cd8-34332dc72c08 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:44.030553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-808f02d8-2183-49ed-a94a-3649a1ce0202 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:44.031589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0256c0be-28bc-4b89-9cd8-34332dc72c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:44.031698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-808f02d8-2183-49ed-a94a-3649a1ce0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:44.055111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:44.077096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:44.099548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 534/1087] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:40:44.100218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 554/1088] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:44.122746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f02d8-2183-49ed-a94a-3649a1ce0202 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.129215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256c0be-28bc-4b89-9cd8-34332dc72c08 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.223163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256c0be-28bc-4b89-9cd8-34332dc72c08 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:44.223621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f02d8-2183-49ed-a94a-3649a1ce0202 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:44.257846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446533-d623-47d6-85c0-9ee1b07152c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:44.258583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446533-d623-47d6-85c0-9ee1b07152c9 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.258863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446533-d623-47d6-85c0-9ee1b07152c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.259170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446533-d623-47d6-85c0-9ee1b07152c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.261018 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513d963-4df4-475f-b486-7145d8469019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:44.261830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d963-4df4-475f-b486-7145d8469019 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.262114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d963-4df4-475f-b486-7145d8469019 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.262393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d963-4df4-475f-b486-7145d8469019 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.269344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65446533-d623-47d6-85c0-9ee1b07152c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:44.272539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513d963-4df4-475f-b486-7145d8469019 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-65446533-d623-47d6-85c0-9ee1b07152c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:44.277324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:44.278807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:44.281177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 555/1089] 10.222.0.42 () {56 vars in 1120 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-e513d963-4df4-475f-b486-7145d8469019 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:40:44.282028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:44.283291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:44.284546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 535/1090] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:44.285581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446533-d623-47d6-85c0-9ee1b07152c9 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.288220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513d963-4df4-475f-b486-7145d8469019 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.308976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:44.328509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:44.387760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446533-d623-47d6-85c0-9ee1b07152c9 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:44.391916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513d963-4df4-475f-b486-7145d8469019 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:44.421636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a6db-1d38-42ee-8930-93d3dfed5d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:44.422303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a6db-1d38-42ee-8930-93d3dfed5d96 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.422585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a6db-1d38-42ee-8930-93d3dfed5d96 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.422867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87a6db-1d38-42ee-8930-93d3dfed5d96 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.423709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a6db-1d38-42ee-8930-93d3dfed5d96 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:44.424019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a6db-1d38-42ee-8930-93d3dfed5d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:44.425667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87a6db-1d38-42ee-8930-93d3dfed5d96 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:44.426146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83f6b0-970c-4627-a3e7-0ac9ba36bb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:44.426803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83f6b0-970c-4627-a3e7-0ac9ba36bb5d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.427128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83f6b0-970c-4627-a3e7-0ac9ba36bb5d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.427404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83f6b0-970c-4627-a3e7-0ac9ba36bb5d None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.428152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83f6b0-970c-4627-a3e7-0ac9ba36bb5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:44.428456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83f6b0-970c-4627-a3e7-0ac9ba36bb5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:44.429815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83f6b0-970c-4627-a3e7-0ac9ba36bb5d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:44.433625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 556/1091] 10.222.0.42 () {56 vars in 1115 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:44.438217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 536/1092] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:44.440192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a6db-1d38-42ee-8930-93d3dfed5d96 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.443650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83f6b0-970c-4627-a3e7-0ac9ba36bb5d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.523688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:44.535017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:44.537830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87a6db-1d38-42ee-8930-93d3dfed5d96 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:44.542734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83f6b0-970c-4627-a3e7-0ac9ba36bb5d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:44.571350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938805-8a6e-44b8-b4e3-5f237fa91e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:44.572135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938805-8a6e-44b8-b4e3-5f237fa91e56 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.572418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938805-8a6e-44b8-b4e3-5f237fa91e56 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.572693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05938805-8a6e-44b8-b4e3-5f237fa91e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.576808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed597a-fc0a-4a01-aa34-7343b45e72a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:44.577671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed597a-fc0a-4a01-aa34-7343b45e72a7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.577952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed597a-fc0a-4a01-aa34-7343b45e72a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.578225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed597a-fc0a-4a01-aa34-7343b45e72a7 None admin] PATH_INFO: `/v3/users/922ef54f8d6c457cbc64d1d4caba5c07` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.579455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed597a-fc0a-4a01-aa34-7343b45e72a7 None admin] RBAC: Authorizing `identity:get_user(user_id=922ef54f8d6c457cbc64d1d4caba5c07)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:44.580890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed597a-fc0a-4a01-aa34-7343b45e72a7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:44.582525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 537/1093] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/users/922ef54f8d6c457cbc64d1d4caba5c07 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:44.582706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938805-8a6e-44b8-b4e3-5f237fa91e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:44.584176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05938805-8a6e-44b8-b4e3-5f237fa91e56 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:44.587992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed597a-fc0a-4a01-aa34-7343b45e72a7 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-05938805-8a6e-44b8-b4e3-5f237fa91e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:44.602260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:44.603336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:44.604219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:44.604219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:44.604219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:44.604219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:44.607111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 557/1094] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:44.609594 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938805-8a6e-44b8-b4e3-5f237fa91e56 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.693282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed597a-fc0a-4a01-aa34-7343b45e72a7 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:44.713308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05938805-8a6e-44b8-b4e3-5f237fa91e56 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:44.727239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229c9a6-366f-4f9c-b2cd-35a791efb1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:44.727907 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229c9a6-366f-4f9c-b2cd-35a791efb1ba None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.728198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229c9a6-366f-4f9c-b2cd-35a791efb1ba None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.728481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229c9a6-366f-4f9c-b2cd-35a791efb1ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.747033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:44.748039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ecc26-df44-4ebf-9f27-b2030dc7fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:44.748698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ecc26-df44-4ebf-9f27-b2030dc7fe1a None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.748980 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ecc26-df44-4ebf-9f27-b2030dc7fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.749256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ecc26-df44-4ebf-9f27-b2030dc7fe1a None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.749979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ecc26-df44-4ebf-9f27-b2030dc7fe1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:44.750285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ecc26-df44-4ebf-9f27-b2030dc7fe1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:44.751691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ecc26-df44-4ebf-9f27-b2030dc7fe1a None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:44.763247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 558/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:44.768652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ecc26-df44-4ebf-9f27-b2030dc7fe1a None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.783174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:44.800791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229c9a6-366f-4f9c-b2cd-35a791efb1ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:44.802244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229c9a6-366f-4f9c-b2cd-35a791efb1ba None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:44.866323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ecc26-df44-4ebf-9f27-b2030dc7fe1a None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:44.899883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45b2a-80a3-4d51-9067-0d263bec7f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:44.900659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 538/1096] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:40:44.900770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45b2a-80a3-4d51-9067-0d263bec7f68 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:44.900942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45b2a-80a3-4d51-9067-0d263bec7f68 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:44.901219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc45b2a-80a3-4d51-9067-0d263bec7f68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:44.907383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229c9a6-366f-4f9c-b2cd-35a791efb1ba None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.909436 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc45b2a-80a3-4d51-9067-0d263bec7f68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:44.910886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc45b2a-80a3-4d51-9067-0d263bec7f68 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-edc45b2a-80a3-4d51-9067-0d263bec7f68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:40:44.924760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:44.925958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:40:44.926887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 559/1097] 10.222.0.42 () {56 vars in 1093 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:40:44.931794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45b2a-80a3-4d51-9067-0d263bec7f68 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:44.955600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:45.003360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:45.007647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229c9a6-366f-4f9c-b2cd-35a791efb1ba None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:45.034408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc45b2a-80a3-4d51-9067-0d263bec7f68 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:45.042384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31756758-ac63-41f4-9d0c-d46350f7a507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:45.043284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31756758-ac63-41f4-9d0c-d46350f7a507 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:45.043565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31756758-ac63-41f4-9d0c-d46350f7a507 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:45.043841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31756758-ac63-41f4-9d0c-d46350f7a507 None admin] PATH_INFO: `/v3/projects/d34c64691f4641c59a3169388f252156` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:45.045014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31756758-ac63-41f4-9d0c-d46350f7a507 None admin] RBAC: Authorizing `identity:get_project(project_id=d34c64691f4641c59a3169388f252156)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:45.046459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31756758-ac63-41f4-9d0c-d46350f7a507 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:45.048249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 539/1098] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/projects/d34c64691f4641c59a3169388f252156 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:45.054464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31756758-ac63-41f4-9d0c-d46350f7a507 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:45.068180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b644049-7df3-4fa9-9bb7-dee801bb0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:45.068931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b644049-7df3-4fa9-9bb7-dee801bb0558 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:45.069124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b644049-7df3-4fa9-9bb7-dee801bb0558 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:45.069401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b644049-7df3-4fa9-9bb7-dee801bb0558 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:45.070236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b644049-7df3-4fa9-9bb7-dee801bb0558 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:45.070544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b644049-7df3-4fa9-9bb7-dee801bb0558 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:45.072027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b644049-7df3-4fa9-9bb7-dee801bb0558 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:45.089836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 560/1099] 10.222.0.42 () {56 vars in 1133 bytes} [Fri May 27 13:40:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:45.095583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b644049-7df3-4fa9-9bb7-dee801bb0558 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:45.155023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31756758-ac63-41f4-9d0c-d46350f7a507 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:45.171347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:45.189772 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb458ac-1e52-41b1-af1d-55f8b5d894b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:45.190483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb458ac-1e52-41b1-af1d-55f8b5d894b4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:45.190769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb458ac-1e52-41b1-af1d-55f8b5d894b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:45.191084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb458ac-1e52-41b1-af1d-55f8b5d894b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:45.191922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb458ac-1e52-41b1-af1d-55f8b5d894b4 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=d34c64691f4641c59a3169388f252156, user.id=922ef54f8d6c457cbc64d1d4caba5c07) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:45.192240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb458ac-1e52-41b1-af1d-55f8b5d894b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:45.192333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b644049-7df3-4fa9-9bb7-dee801bb0558 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:45.193683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb458ac-1e52-41b1-af1d-55f8b5d894b4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:45.200116 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 540/1100] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:45 2022] GET /identity/v3/role_assignments?user.id=922ef54f8d6c457cbc64d1d4caba5c07&scope.project.id=d34c64691f4641c59a3169388f252156&role.id=3951cc86a51d416fafc5676d456e79ce => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:45.222294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:45.228358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490128c2-e9c9-4266-b96c-4752c041dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:45.229030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490128c2-e9c9-4266-b96c-4752c041dd45 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:45.229563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490128c2-e9c9-4266-b96c-4752c041dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:45.229563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490128c2-e9c9-4266-b96c-4752c041dd45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:45.303866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490128c2-e9c9-4266-b96c-4752c041dd45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:45.305244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490128c2-e9c9-4266-b96c-4752c041dd45 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:45.408138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 561/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 13:40:45.414023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb458ac-1e52-41b1-af1d-55f8b5d894b4 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:45.513635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb458ac-1e52-41b1-af1d-55f8b5d894b4 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:45.546844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541eaf7-ddcd-4adc-b883-086e85ffa752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:45.547696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541eaf7-ddcd-4adc-b883-086e85ffa752 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:45.547984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541eaf7-ddcd-4adc-b883-086e85ffa752 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:45.548262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541eaf7-ddcd-4adc-b883-086e85ffa752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:45.559037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541eaf7-ddcd-4adc-b883-086e85ffa752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:45.560410 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541eaf7-ddcd-4adc-b883-086e85ffa752 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-0541eaf7-ddcd-4adc-b883-086e85ffa752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:40:45.577852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:45.578935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:45.579879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:40:45.579879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:40:45.579879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:40:45.579879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:45.579879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 541/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:45.584650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490128c2-e9c9-4266-b96c-4752c041dd45 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:45.614540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:45.684381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490128c2-e9c9-4266-b96c-4752c041dd45 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:45.717110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4178b8-46ee-443b-adb3-b3a2d694e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:45.717768 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4178b8-46ee-443b-adb3-b3a2d694e412 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:45.718045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4178b8-46ee-443b-adb3-b3a2d694e412 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:45.718317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4178b8-46ee-443b-adb3-b3a2d694e412 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:45.719051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4178b8-46ee-443b-adb3-b3a2d694e412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:45.719355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4178b8-46ee-443b-adb3-b3a2d694e412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:45.720706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4178b8-46ee-443b-adb3-b3a2d694e412 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:45.732634 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 562/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:45.738249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541eaf7-ddcd-4adc-b883-086e85ffa752 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:45.769612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:45.837920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541eaf7-ddcd-4adc-b883-086e85ffa752 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:45.871352 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3e19a-222b-4c54-90d1-8b4255cf98e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:45.872117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3e19a-222b-4c54-90d1-8b4255cf98e4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:45.872401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3e19a-222b-4c54-90d1-8b4255cf98e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:45.872678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3e19a-222b-4c54-90d1-8b4255cf98e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:45.879351 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3e19a-222b-4c54-90d1-8b4255cf98e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:45.880799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3e19a-222b-4c54-90d1-8b4255cf98e4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-a5c3e19a-222b-4c54-90d1-8b4255cf98e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:40:45.894894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:40:45.895971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:40:45.896921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:40:45.896921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:40:45.896921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:40:45.896921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:40:45.896921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:40:45.896921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:40:45.896921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:40:45.896921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:40:45.896921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 542/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:40:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:40:45.901909 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4178b8-46ee-443b-adb3-b3a2d694e412 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:45.991217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:46.000694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4178b8-46ee-443b-adb3-b3a2d694e412 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:46.042378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b7df5-2d7d-4083-a710-1eab9c985014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:46.043396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b7df5-2d7d-4083-a710-1eab9c985014 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:46.043887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b7df5-2d7d-4083-a710-1eab9c985014 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:46.044574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b7df5-2d7d-4083-a710-1eab9c985014 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:46.045364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b7df5-2d7d-4083-a710-1eab9c985014 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:46.045677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b7df5-2d7d-4083-a710-1eab9c985014 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:46.047244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b7df5-2d7d-4083-a710-1eab9c985014 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:46.059703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 563/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:40:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:46.065719 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3e19a-222b-4c54-90d1-8b4255cf98e4 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:46.158280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:46.166822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3e19a-222b-4c54-90d1-8b4255cf98e4 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:46.201861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b7b25-55c3-41c3-83de-0442311733f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:46.202502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b7b25-55c3-41c3-83de-0442311733f3 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:46.202783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b7b25-55c3-41c3-83de-0442311733f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:46.203090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b7b25-55c3-41c3-83de-0442311733f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:46.203944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b7b25-55c3-41c3-83de-0442311733f3 None admin] RBAC: Adding query filter params (role.id=d88071d05f2e438dbbe25f0bcd08b9a4, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=9a1644fa5cd3499d9d6ad057067255e9) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:46.204252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b7b25-55c3-41c3-83de-0442311733f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:46.205684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b7b25-55c3-41c3-83de-0442311733f3 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:46.211609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 543/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:46 2022] GET /identity/v3/role_assignments?user.id=9a1644fa5cd3499d9d6ad057067255e9&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=d88071d05f2e438dbbe25f0bcd08b9a4 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:47.463399 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277cad-2ca7-44a0-bcd8-318ea76c3729 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:47.463970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277cad-2ca7-44a0-bcd8-318ea76c3729 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:47.463970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c277cad-2ca7-44a0-bcd8-318ea76c3729 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:47.465865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 564/1107] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:47.471184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c7f2-5282-41cb-bf76-5ccb2079ee0e None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:47.471608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c7f2-5282-41cb-bf76-5ccb2079ee0e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:47.471724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c7f2-5282-41cb-bf76-5ccb2079ee0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:47.488689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a063c7f2-5282-41cb-bf76-5ccb2079ee0e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:47.489857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a063c7f2-5282-41cb-bf76-5ccb2079ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:47.554291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 544/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:47.579140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277cad-2ca7-44a0-bcd8-318ea76c3729 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:47.680739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c277cad-2ca7-44a0-bcd8-318ea76c3729 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:47.713231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd138e-de69-4a1b-99fb-a1a2885d4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:47.714053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd138e-de69-4a1b-99fb-a1a2885d4934 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:47.714283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd138e-de69-4a1b-99fb-a1a2885d4934 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:47.714566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd138e-de69-4a1b-99fb-a1a2885d4934 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:47.716492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd138e-de69-4a1b-99fb-a1a2885d4934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:47.717901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd138e-de69-4a1b-99fb-a1a2885d4934 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:47.719535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 565/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:47.725224 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063c7f2-5282-41cb-bf76-5ccb2079ee0e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:47.808291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:47.822364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063c7f2-5282-41cb-bf76-5ccb2079ee0e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:47.856191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d21b7e-e13e-480f-8ed6-d598ca2a01eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:47.856867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d21b7e-e13e-480f-8ed6-d598ca2a01eb None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:47.857492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d21b7e-e13e-480f-8ed6-d598ca2a01eb None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:47.857771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d21b7e-e13e-480f-8ed6-d598ca2a01eb None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:47.858487 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d21b7e-e13e-480f-8ed6-d598ca2a01eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:47.859961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d21b7e-e13e-480f-8ed6-d598ca2a01eb None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:47.964026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 545/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:40:47 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:40:50.212418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed7f55-4d96-4e50-b06c-9c6da68d07c2 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:50.213007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed7f55-4d96-4e50-b06c-9c6da68d07c2 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:50.213007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed7f55-4d96-4e50-b06c-9c6da68d07c2 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:50.214725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 566/1111] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:50.220785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495b587-d529-4b56-9620-835a1b222b39 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:50.221231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495b587-d529-4b56-9620-835a1b222b39 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:50.221350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495b587-d529-4b56-9620-835a1b222b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:50.239196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3495b587-d529-4b56-9620-835a1b222b39 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:50.239372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3495b587-d529-4b56-9620-835a1b222b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:50.314132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 546/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:50.338494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed7f55-4d96-4e50-b06c-9c6da68d07c2 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:50.357976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:50.444151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed7f55-4d96-4e50-b06c-9c6da68d07c2 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:50.477485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe44d5-545a-40be-b7cf-2a4748390a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:50.478339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe44d5-545a-40be-b7cf-2a4748390a0b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:50.478623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe44d5-545a-40be-b7cf-2a4748390a0b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:50.478898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe44d5-545a-40be-b7cf-2a4748390a0b None admin] PATH_INFO: `/v3/roles/a97f5aba7e1b4044b2c749cba5d5708f` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:50.480417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe44d5-545a-40be-b7cf-2a4748390a0b None admin] RBAC: Authorizing `identity:get_role(role_id=a97f5aba7e1b4044b2c749cba5d5708f)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:50.482294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe44d5-545a-40be-b7cf-2a4748390a0b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:50.483702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 567/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:40:50 2022] GET /identity/v3/roles/a97f5aba7e1b4044b2c749cba5d5708f => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:50.489581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495b587-d529-4b56-9620-835a1b222b39 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:50.558792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:50.587095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495b587-d529-4b56-9620-835a1b222b39 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:50.621993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b53910-007f-47ef-9b31-ef537026a50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:50.622875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53910-007f-47ef-9b31-ef537026a50c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:50.623603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53910-007f-47ef-9b31-ef537026a50c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:50.623883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53910-007f-47ef-9b31-ef537026a50c None admin] PATH_INFO: `/v3/users/51ad93caeeda43779c0f5ebe8737ddd5` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:50.636485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b53910-007f-47ef-9b31-ef537026a50c None admin] RBAC: Authorizing `identity:get_user(user_id=51ad93caeeda43779c0f5ebe8737ddd5)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:50.638009 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b53910-007f-47ef-9b31-ef537026a50c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:50.639822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 547/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:40:50 2022] GET /identity/v3/users/51ad93caeeda43779c0f5ebe8737ddd5 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:50.645712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe44d5-545a-40be-b7cf-2a4748390a0b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:50.730939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:50.744890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe44d5-545a-40be-b7cf-2a4748390a0b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:50.777332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa35f1-04bc-4891-8c53-7dc7d2936af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:50.778544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa35f1-04bc-4891-8c53-7dc7d2936af8 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:50.778820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa35f1-04bc-4891-8c53-7dc7d2936af8 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:50.779118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa35f1-04bc-4891-8c53-7dc7d2936af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:50.844222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa35f1-04bc-4891-8c53-7dc7d2936af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:50.845643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa35f1-04bc-4891-8c53-7dc7d2936af8 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:50.925278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:50.940822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 568/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:40:50.946929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b53910-007f-47ef-9b31-ef537026a50c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:51.046429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b53910-007f-47ef-9b31-ef537026a50c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:51.074793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:51.080206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a890cf-2b28-4d0c-8048-4250df96445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:51.081061 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a890cf-2b28-4d0c-8048-4250df96445b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:51.087309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a890cf-2b28-4d0c-8048-4250df96445b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:51.087309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a890cf-2b28-4d0c-8048-4250df96445b None admin] PATH_INFO: `/v3/projects/d34c64691f4641c59a3169388f252156` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:51.087309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a890cf-2b28-4d0c-8048-4250df96445b None admin] RBAC: Authorizing `identity:get_project(project_id=d34c64691f4641c59a3169388f252156)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:51.087309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a890cf-2b28-4d0c-8048-4250df96445b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:51.087309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 548/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:40:50 2022] GET /identity/v3/projects/d34c64691f4641c59a3169388f252156 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:51.093155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa35f1-04bc-4891-8c53-7dc7d2936af8 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:51.190108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa35f1-04bc-4891-8c53-7dc7d2936af8 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:51.222456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588bf22-53ae-4bf6-ac11-37a6aeef7be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:51.223107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588bf22-53ae-4bf6-ac11-37a6aeef7be3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:51.223383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588bf22-53ae-4bf6-ac11-37a6aeef7be3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:51.223654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588bf22-53ae-4bf6-ac11-37a6aeef7be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:51.224466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588bf22-53ae-4bf6-ac11-37a6aeef7be3 None admin] RBAC: Adding query filter params (role.id=a97f5aba7e1b4044b2c749cba5d5708f, scope.project.id=d34c64691f4641c59a3169388f252156, user.id=51ad93caeeda43779c0f5ebe8737ddd5) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:51.224772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588bf22-53ae-4bf6-ac11-37a6aeef7be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:51.226186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588bf22-53ae-4bf6-ac11-37a6aeef7be3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:51.231639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 569/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:51 2022] GET /identity/v3/role_assignments?user.id=51ad93caeeda43779c0f5ebe8737ddd5&scope.project.id=d34c64691f4641c59a3169388f252156&role.id=a97f5aba7e1b4044b2c749cba5d5708f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:53.391733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79307d7-90c1-45aa-b2fe-b7891f316740 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:53.392307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79307d7-90c1-45aa-b2fe-b7891f316740 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:53.392307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79307d7-90c1-45aa-b2fe-b7891f316740 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:53.393656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 549/1118] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:53.398934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55202e76-b61c-4121-8da5-c3af74544501 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:53.399392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55202e76-b61c-4121-8da5-c3af74544501 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:53.399499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55202e76-b61c-4121-8da5-c3af74544501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:53.417126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-55202e76-b61c-4121-8da5-c3af74544501 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:53.418917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-55202e76-b61c-4121-8da5-c3af74544501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:53.462766 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:53.484305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 570/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:53.506819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79307d7-90c1-45aa-b2fe-b7891f316740 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:53.610057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79307d7-90c1-45aa-b2fe-b7891f316740 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:53.643280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd749cab-5bcc-49ea-b5f0-51c6c13f1b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:53.644072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd749cab-5bcc-49ea-b5f0-51c6c13f1b4f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:53.644359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd749cab-5bcc-49ea-b5f0-51c6c13f1b4f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:53.644638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd749cab-5bcc-49ea-b5f0-51c6c13f1b4f None admin] PATH_INFO: `/v3/roles/a97f5aba7e1b4044b2c749cba5d5708f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:53.646131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd749cab-5bcc-49ea-b5f0-51c6c13f1b4f None admin] RBAC: Authorizing `identity:get_role(role_id=a97f5aba7e1b4044b2c749cba5d5708f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:53.647546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd749cab-5bcc-49ea-b5f0-51c6c13f1b4f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:53.648943 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 550/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:40:53 2022] GET /identity/v3/roles/a97f5aba7e1b4044b2c749cba5d5708f => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:53.655651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55202e76-b61c-4121-8da5-c3af74544501 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:53.753475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55202e76-b61c-4121-8da5-c3af74544501 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:53.787866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb99d8-9db1-480b-a50d-17134f495ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:53.788715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb99d8-9db1-480b-a50d-17134f495ee5 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:53.788997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb99d8-9db1-480b-a50d-17134f495ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:53.789482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb99d8-9db1-480b-a50d-17134f495ee5 None admin] PATH_INFO: `/v3/users/51ad93caeeda43779c0f5ebe8737ddd5` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:53.791530 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb99d8-9db1-480b-a50d-17134f495ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=51ad93caeeda43779c0f5ebe8737ddd5)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:53.793084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb99d8-9db1-480b-a50d-17134f495ee5 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:53.795375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 571/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:40:53 2022] GET /identity/v3/users/51ad93caeeda43779c0f5ebe8737ddd5 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:53.801386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd749cab-5bcc-49ea-b5f0-51c6c13f1b4f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:53.864884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:53.898261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd749cab-5bcc-49ea-b5f0-51c6c13f1b4f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:53.931571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2278c61-beb4-4229-85bd-f84e4dc0e92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:53.932411 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278c61-beb4-4229-85bd-f84e4dc0e92a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:53.932690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278c61-beb4-4229-85bd-f84e4dc0e92a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:53.932961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2278c61-beb4-4229-85bd-f84e4dc0e92a None admin] PATH_INFO: `/v3/projects/d34c64691f4641c59a3169388f252156` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:53.934731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2278c61-beb4-4229-85bd-f84e4dc0e92a None admin] RBAC: Authorizing `identity:get_project(project_id=d34c64691f4641c59a3169388f252156)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:53.936200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2278c61-beb4-4229-85bd-f84e4dc0e92a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:53.937869 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 551/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:40:53 2022] GET /identity/v3/projects/d34c64691f4641c59a3169388f252156 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:53.943717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb99d8-9db1-480b-a50d-17134f495ee5 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:53.992626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:54.043452 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb99d8-9db1-480b-a50d-17134f495ee5 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:54.078453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5392a8-77ef-4c7e-9509-bcbd8158da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:54.079363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5392a8-77ef-4c7e-9509-bcbd8158da2c None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:54.079650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5392a8-77ef-4c7e-9509-bcbd8158da2c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:54.079929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5392a8-77ef-4c7e-9509-bcbd8158da2c None admin] PATH_INFO: `/v3/projects/d34c64691f4641c59a3169388f252156/users/51ad93caeeda43779c0f5ebe8737ddd5/roles/a97f5aba7e1b4044b2c749cba5d5708f` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:54.082171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5392a8-77ef-4c7e-9509-bcbd8158da2c None admin] RBAC: Authorizing `identity:create_grant(project_id=d34c64691f4641c59a3169388f252156, user_id=51ad93caeeda43779c0f5ebe8737ddd5, role_id=a97f5aba7e1b4044b2c749cba5d5708f)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:54.083639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5392a8-77ef-4c7e-9509-bcbd8158da2c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:54.135333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 572/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:40:53 2022] PUT /identity/v3/projects/d34c64691f4641c59a3169388f252156/users/51ad93caeeda43779c0f5ebe8737ddd5/roles/a97f5aba7e1b4044b2c749cba5d5708f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:40:56.296512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6199fa-2074-4879-9bd1-6598fca91333 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:56.297056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6199fa-2074-4879-9bd1-6598fca91333 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:56.297056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6199fa-2074-4879-9bd1-6598fca91333 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:56.298414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 552/1124] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:56.303948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6688c9c-749e-413f-bf6d-d3ae0b6a0a55 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:56.304372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6688c9c-749e-413f-bf6d-d3ae0b6a0a55 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:56.304509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6688c9c-749e-413f-bf6d-d3ae0b6a0a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:56.321535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b6688c9c-749e-413f-bf6d-d3ae0b6a0a55 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:56.322716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b6688c9c-749e-413f-bf6d-d3ae0b6a0a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:56.389227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 573/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:56.412506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6199fa-2074-4879-9bd1-6598fca91333 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:56.514480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6199fa-2074-4879-9bd1-6598fca91333 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:56.548431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d1415-6182-44dc-81b1-d1b5613f38ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:56.549254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d1415-6182-44dc-81b1-d1b5613f38ba None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:56.549538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d1415-6182-44dc-81b1-d1b5613f38ba None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:56.549823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d1415-6182-44dc-81b1-d1b5613f38ba None admin] PATH_INFO: `/v3/roles/a97f5aba7e1b4044b2c749cba5d5708f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:56.551619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d1415-6182-44dc-81b1-d1b5613f38ba None admin] RBAC: Authorizing `identity:get_role(role_id=a97f5aba7e1b4044b2c749cba5d5708f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:56.553038 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d1415-6182-44dc-81b1-d1b5613f38ba None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:56.554422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 553/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:40:56 2022] GET /identity/v3/roles/a97f5aba7e1b4044b2c749cba5d5708f => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:56.560265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6688c9c-749e-413f-bf6d-d3ae0b6a0a55 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:56.598561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:56.656107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6688c9c-749e-413f-bf6d-d3ae0b6a0a55 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:56.690352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f74f5-304c-48fb-af13-a71b06b35877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:56.691248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f74f5-304c-48fb-af13-a71b06b35877 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:56.691531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f74f5-304c-48fb-af13-a71b06b35877 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:56.691804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f74f5-304c-48fb-af13-a71b06b35877 None admin] PATH_INFO: `/v3/users/51ad93caeeda43779c0f5ebe8737ddd5` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:56.692969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f74f5-304c-48fb-af13-a71b06b35877 None admin] RBAC: Authorizing `identity:get_user(user_id=51ad93caeeda43779c0f5ebe8737ddd5)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:56.694402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f74f5-304c-48fb-af13-a71b06b35877 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:56.696063 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 574/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:40:56 2022] GET /identity/v3/users/51ad93caeeda43779c0f5ebe8737ddd5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:56.702605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d1415-6182-44dc-81b1-d1b5613f38ba None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:56.705518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:56.801312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d1415-6182-44dc-81b1-d1b5613f38ba None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:56.834062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a6a49-3b6f-466b-b094-3c27c97507ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:56.834700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a6a49-3b6f-466b-b094-3c27c97507ee None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:56.835004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a6a49-3b6f-466b-b094-3c27c97507ee None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:56.835283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a6a49-3b6f-466b-b094-3c27c97507ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:56.901461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a6a49-3b6f-466b-b094-3c27c97507ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:56.903507 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a6a49-3b6f-466b-b094-3c27c97507ee None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:56.905295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:56.999276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 554/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:40:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:40:57.005264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f74f5-304c-48fb-af13-a71b06b35877 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:57.102372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f74f5-304c-48fb-af13-a71b06b35877 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:57.110009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:57.135514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc9ff8-cd0a-43d9-b567-b13a302d2068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:57.136353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc9ff8-cd0a-43d9-b567-b13a302d2068 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:57.136820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc9ff8-cd0a-43d9-b567-b13a302d2068 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:57.137243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc9ff8-cd0a-43d9-b567-b13a302d2068 None admin] PATH_INFO: `/v3/projects/d34c64691f4641c59a3169388f252156` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:57.138423 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc9ff8-cd0a-43d9-b567-b13a302d2068 None admin] RBAC: Authorizing `identity:get_project(project_id=d34c64691f4641c59a3169388f252156)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:57.139885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc9ff8-cd0a-43d9-b567-b13a302d2068 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:57.141561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 575/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:40:57 2022] GET /identity/v3/projects/d34c64691f4641c59a3169388f252156 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:57.147609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a6a49-3b6f-466b-b094-3c27c97507ee None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:57.252605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a6a49-3b6f-466b-b094-3c27c97507ee None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:57.254112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:57.285281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f410a-081b-41a2-b6b6-1db088720f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:57.285935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f410a-081b-41a2-b6b6-1db088720f05 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:57.286216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f410a-081b-41a2-b6b6-1db088720f05 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:57.286490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f410a-081b-41a2-b6b6-1db088720f05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:57.287334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f410a-081b-41a2-b6b6-1db088720f05 None admin] RBAC: Adding query filter params (role.id=a97f5aba7e1b4044b2c749cba5d5708f, scope.project.id=d34c64691f4641c59a3169388f252156, user.id=51ad93caeeda43779c0f5ebe8737ddd5) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:40:57.287646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f410a-081b-41a2-b6b6-1db088720f05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:57.289066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f410a-081b-41a2-b6b6-1db088720f05 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:57.295567 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 555/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:40:57 2022] GET /identity/v3/role_assignments?user.id=51ad93caeeda43779c0f5ebe8737ddd5&scope.project.id=d34c64691f4641c59a3169388f252156&role.id=a97f5aba7e1b4044b2c749cba5d5708f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:40:59.491873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dd1d6-e8c7-414d-968d-db87f8d86d64 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:59.492439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dd1d6-e8c7-414d-968d-db87f8d86d64 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:59.492439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dd1d6-e8c7-414d-968d-db87f8d86d64 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:59.493822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 576/1131] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:40:59.499348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36913def-39de-4b8e-ba03-b0607481fdd4 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:59.499734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36913def-39de-4b8e-ba03-b0607481fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:59.499891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36913def-39de-4b8e-ba03-b0607481fdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:59.516281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-36913def-39de-4b8e-ba03-b0607481fdd4 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:40:59.517452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-36913def-39de-4b8e-ba03-b0607481fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:40:59.581830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 556/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:40:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:40:59.605019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dd1d6-e8c7-414d-968d-db87f8d86d64 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:59.705452 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33dd1d6-e8c7-414d-968d-db87f8d86d64 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:59.738725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51b365-1da2-4a77-abb7-f72ea734dba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:59.739521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51b365-1da2-4a77-abb7-f72ea734dba3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:59.739798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51b365-1da2-4a77-abb7-f72ea734dba3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:59.740067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51b365-1da2-4a77-abb7-f72ea734dba3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:59.741236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51b365-1da2-4a77-abb7-f72ea734dba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:59.742707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce51b365-1da2-4a77-abb7-f72ea734dba3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:40:59.744276 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 577/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:40:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:40:59.750878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36913def-39de-4b8e-ba03-b0607481fdd4 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:40:59.840952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:40:59.846484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36913def-39de-4b8e-ba03-b0607481fdd4 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:40:59.882043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a1a57-1d5a-4a6d-9292-978634854137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:40:59.882699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a1a57-1d5a-4a6d-9292-978634854137 None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:40:59.883010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a1a57-1d5a-4a6d-9292-978634854137 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:40:59.883280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a1a57-1d5a-4a6d-9292-978634854137 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:40:59.883980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a1a57-1d5a-4a6d-9292-978634854137 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:40:59.885427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a1a57-1d5a-4a6d-9292-978634854137 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:00.051818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 557/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:40:59 2022] POST /identity/v3/projects => generated 311 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:41:02.289949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae78f79-373c-4585-b084-758f8bc30d08 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:02.290547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae78f79-373c-4585-b084-758f8bc30d08 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:02.290547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae78f79-373c-4585-b084-758f8bc30d08 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:02.291890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 578/1135] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:02.297680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8088e0-5627-4227-a62c-0127f97a81ce None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:02.298090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8088e0-5627-4227-a62c-0127f97a81ce None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:02.298245 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8088e0-5627-4227-a62c-0127f97a81ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:02.315728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4b8088e0-5627-4227-a62c-0127f97a81ce None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:02.316914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4b8088e0-5627-4227-a62c-0127f97a81ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:02.381692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 558/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:41:02.408284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae78f79-373c-4585-b084-758f8bc30d08 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:02.451775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:02.507050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae78f79-373c-4585-b084-758f8bc30d08 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:02.539595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3369ea-fbf5-4980-896e-3237eefcc3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:02.540414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3369ea-fbf5-4980-896e-3237eefcc3f0 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:02.540642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3369ea-fbf5-4980-896e-3237eefcc3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:02.540912 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3369ea-fbf5-4980-896e-3237eefcc3f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:02.542053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3369ea-fbf5-4980-896e-3237eefcc3f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:02.544322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3369ea-fbf5-4980-896e-3237eefcc3f0 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:02.545905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 579/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:41:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:02.551898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8088e0-5627-4227-a62c-0127f97a81ce None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:02.627560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:02.648435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8088e0-5627-4227-a62c-0127f97a81ce None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:02.681937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef4c3d-b11e-416f-91a4-1a1d806bbf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:02.682619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef4c3d-b11e-416f-91a4-1a1d806bbf16 None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:02.683154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef4c3d-b11e-416f-91a4-1a1d806bbf16 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:02.684122 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef4c3d-b11e-416f-91a4-1a1d806bbf16 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:02.684895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef4c3d-b11e-416f-91a4-1a1d806bbf16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:02.686881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef4c3d-b11e-416f-91a4-1a1d806bbf16 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:02.792386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 559/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:41:02 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:41:04.995419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387324c-152f-4448-8ee3-8507a5a8bb80 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:04.995961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387324c-152f-4448-8ee3-8507a5a8bb80 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:04.995961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387324c-152f-4448-8ee3-8507a5a8bb80 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:04.997547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 580/1139] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:05.002825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1ef5d-0202-497b-af22-c57ef57db80a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:05.003256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1ef5d-0202-497b-af22-c57ef57db80a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:05.003416 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1ef5d-0202-497b-af22-c57ef57db80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:05.020670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8ba1ef5d-0202-497b-af22-c57ef57db80a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:05.021849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8ba1ef5d-0202-497b-af22-c57ef57db80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:05.091256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 560/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:41:05.114191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387324c-152f-4448-8ee3-8507a5a8bb80 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:05.212600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387324c-152f-4448-8ee3-8507a5a8bb80 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:05.223607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:05.245349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f078b2-f9c9-4e50-b5c7-bafd6d54e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:05.246169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f078b2-f9c9-4e50-b5c7-bafd6d54e4fd None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:05.246403 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f078b2-f9c9-4e50-b5c7-bafd6d54e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:05.246673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f078b2-f9c9-4e50-b5c7-bafd6d54e4fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:05.257080 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f078b2-f9c9-4e50-b5c7-bafd6d54e4fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-74f078b2-f9c9-4e50-b5c7-bafd6d54e4fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:41:05.265274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:41:05.266411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:41:05.267513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 581/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:41:05.272500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1ef5d-0202-497b-af22-c57ef57db80a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:05.332429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:05.367600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1ef5d-0202-497b-af22-c57ef57db80a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:05.401418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da86d1-7350-4c05-811f-e53df5b5053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:05.402085 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da86d1-7350-4c05-811f-e53df5b5053b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:05.402371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da86d1-7350-4c05-811f-e53df5b5053b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:05.402649 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da86d1-7350-4c05-811f-e53df5b5053b None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:05.403441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da86d1-7350-4c05-811f-e53df5b5053b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:05.403970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da86d1-7350-4c05-811f-e53df5b5053b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:05.405718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da86d1-7350-4c05-811f-e53df5b5053b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:05.418825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 561/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:05.419936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f078b2-f9c9-4e50-b5c7-bafd6d54e4fd None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:05.520337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f078b2-f9c9-4e50-b5c7-bafd6d54e4fd None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:05.552526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3c3dc-f494-4cb9-b1e0-beaa84fb62a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:05.553380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3c3dc-f494-4cb9-b1e0-beaa84fb62a0 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:05.553661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3c3dc-f494-4cb9-b1e0-beaa84fb62a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:05.553936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3c3dc-f494-4cb9-b1e0-beaa84fb62a0 None admin] PATH_INFO: `/v3/users/a54388c338af4ba5a32694b2919a9452` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:05.567325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3c3dc-f494-4cb9-b1e0-beaa84fb62a0 None admin] RBAC: Authorizing `identity:get_user(user_id=a54388c338af4ba5a32694b2919a9452)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:05.568755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3c3dc-f494-4cb9-b1e0-beaa84fb62a0 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:05.570391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 582/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:41:05 2022] GET /identity/v3/users/a54388c338af4ba5a32694b2919a9452 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:41:05.576726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da86d1-7350-4c05-811f-e53df5b5053b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:05.673786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da86d1-7350-4c05-811f-e53df5b5053b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:05.698782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:05.707189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976325bc-5715-47ea-80f5-ab7bc697a44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:05.716435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976325bc-5715-47ea-80f5-ab7bc697a44f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:05.716435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976325bc-5715-47ea-80f5-ab7bc697a44f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:05.716435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976325bc-5715-47ea-80f5-ab7bc697a44f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:05.773468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976325bc-5715-47ea-80f5-ab7bc697a44f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:05.774850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976325bc-5715-47ea-80f5-ab7bc697a44f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:05.869450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 562/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:41:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:41:05.876140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3c3dc-f494-4cb9-b1e0-beaa84fb62a0 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:05.903106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:05.972839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3c3dc-f494-4cb9-b1e0-beaa84fb62a0 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:06.006269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f1497-7a4b-4df6-a191-11c207b907ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:06.007142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f1497-7a4b-4df6-a191-11c207b907ac None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:06.007427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f1497-7a4b-4df6-a191-11c207b907ac None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:06.007703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f1497-7a4b-4df6-a191-11c207b907ac None admin] PATH_INFO: `/v3/projects/7370285f13064478a29dcc94ea3746b7` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:06.008880 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f1497-7a4b-4df6-a191-11c207b907ac None admin] RBAC: Authorizing `identity:get_project(project_id=7370285f13064478a29dcc94ea3746b7)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:06.010311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f1497-7a4b-4df6-a191-11c207b907ac None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:06.012034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 583/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:41:05 2022] GET /identity/v3/projects/7370285f13064478a29dcc94ea3746b7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:06.018151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976325bc-5715-47ea-80f5-ab7bc697a44f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:06.044506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:06.114674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976325bc-5715-47ea-80f5-ab7bc697a44f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:06.146908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01544f20-d3c6-43f3-b265-8d2ca4a3b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:06.147582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544f20-d3c6-43f3-b265-8d2ca4a3b9e4 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:06.147862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544f20-d3c6-43f3-b265-8d2ca4a3b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:06.148135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544f20-d3c6-43f3-b265-8d2ca4a3b9e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:06.148954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01544f20-d3c6-43f3-b265-8d2ca4a3b9e4 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=7370285f13064478a29dcc94ea3746b7, user.id=a54388c338af4ba5a32694b2919a9452) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:06.149262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01544f20-d3c6-43f3-b265-8d2ca4a3b9e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:06.150676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01544f20-d3c6-43f3-b265-8d2ca4a3b9e4 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:06.156628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 563/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:41:06 2022] GET /identity/v3/role_assignments?user.id=a54388c338af4ba5a32694b2919a9452&scope.project.id=7370285f13064478a29dcc94ea3746b7&role.id=3951cc86a51d416fafc5676d456e79ce => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:08.318431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cbeda-5fa2-4e89-ad03-4d6a1092382f None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:08.319041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cbeda-5fa2-4e89-ad03-4d6a1092382f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:08.319041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cbeda-5fa2-4e89-ad03-4d6a1092382f None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:08.320380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 584/1147] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:08.325491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce0282-7265-44e1-bf6c-ae1ffe1b6217 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:08.326609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce0282-7265-44e1-bf6c-ae1ffe1b6217 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:08.326609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce0282-7265-44e1-bf6c-ae1ffe1b6217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:08.343218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-06ce0282-7265-44e1-bf6c-ae1ffe1b6217 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:08.344381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-06ce0282-7265-44e1-bf6c-ae1ffe1b6217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:08.408354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 564/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:41:08.430353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cbeda-5fa2-4e89-ad03-4d6a1092382f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:08.524985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:08.531257 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cbeda-5fa2-4e89-ad03-4d6a1092382f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:08.564914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9fd2-6f2c-408b-8aed-2fb53df78c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:08.565683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9fd2-6f2c-408b-8aed-2fb53df78c77 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:08.565966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9fd2-6f2c-408b-8aed-2fb53df78c77 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:08.566241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9fd2-6f2c-408b-8aed-2fb53df78c77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:08.576226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f9fd2-6f2c-408b-8aed-2fb53df78c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-866f9fd2-6f2c-408b-8aed-2fb53df78c77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:41:08.584298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:41:08.585379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:41:08.586296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 585/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:41:08.591432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce0282-7265-44e1-bf6c-ae1ffe1b6217 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:08.611725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:08.689264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce0282-7265-44e1-bf6c-ae1ffe1b6217 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:08.722142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc36fde-aac3-4bc0-910e-3c2b413335fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:08.722797 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc36fde-aac3-4bc0-910e-3c2b413335fc None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:08.723114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc36fde-aac3-4bc0-910e-3c2b413335fc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:08.723393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc36fde-aac3-4bc0-910e-3c2b413335fc None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:08.724139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc36fde-aac3-4bc0-910e-3c2b413335fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:08.724447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc36fde-aac3-4bc0-910e-3c2b413335fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:08.725817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc36fde-aac3-4bc0-910e-3c2b413335fc None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:08.734298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 565/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:41:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:08.740036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9fd2-6f2c-408b-8aed-2fb53df78c77 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:08.836613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9fd2-6f2c-408b-8aed-2fb53df78c77 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:08.869266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f1dc-9222-4469-a8a5-81369a66a550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:08.870111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f1dc-9222-4469-a8a5-81369a66a550 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:08.870389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f1dc-9222-4469-a8a5-81369a66a550 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:08.870657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f1dc-9222-4469-a8a5-81369a66a550 None admin] PATH_INFO: `/v3/users/a54388c338af4ba5a32694b2919a9452` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:08.871851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f1dc-9222-4469-a8a5-81369a66a550 None admin] RBAC: Authorizing `identity:get_user(user_id=a54388c338af4ba5a32694b2919a9452)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:08.873976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9f1dc-9222-4469-a8a5-81369a66a550 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:08.875601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 586/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:41:08 2022] GET /identity/v3/users/a54388c338af4ba5a32694b2919a9452 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:08.881197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc36fde-aac3-4bc0-910e-3c2b413335fc None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:08.960576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:08.977813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc36fde-aac3-4bc0-910e-3c2b413335fc None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:09.011471 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d02e4-105a-4116-a17e-5037feeeb0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:09.012319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d02e4-105a-4116-a17e-5037feeeb0a7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:09.012606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d02e4-105a-4116-a17e-5037feeeb0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:09.012887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d02e4-105a-4116-a17e-5037feeeb0a7 None admin] PATH_INFO: `/v3/projects/7370285f13064478a29dcc94ea3746b7` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:09.014108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d02e4-105a-4116-a17e-5037feeeb0a7 None admin] RBAC: Authorizing `identity:get_project(project_id=7370285f13064478a29dcc94ea3746b7)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:09.015572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d02e4-105a-4116-a17e-5037feeeb0a7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:09.017254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 566/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:41:08 2022] GET /identity/v3/projects/7370285f13064478a29dcc94ea3746b7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:09.023011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f1dc-9222-4469-a8a5-81369a66a550 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:09.048927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:09.120155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f1dc-9222-4469-a8a5-81369a66a550 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:09.152004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f632ba-528e-4a05-b81a-77f1a98b5608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:09.152867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f632ba-528e-4a05-b81a-77f1a98b5608 None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:09.153146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f632ba-528e-4a05-b81a-77f1a98b5608 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:09.153417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f632ba-528e-4a05-b81a-77f1a98b5608 None admin] PATH_INFO: `/v3/projects/7370285f13064478a29dcc94ea3746b7/users/a54388c338af4ba5a32694b2919a9452/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:09.155973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f632ba-528e-4a05-b81a-77f1a98b5608 None admin] RBAC: Authorizing `identity:create_grant(project_id=7370285f13064478a29dcc94ea3746b7, user_id=a54388c338af4ba5a32694b2919a9452, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:09.157386 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f632ba-528e-4a05-b81a-77f1a98b5608 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:09.255169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 587/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:41:09 2022] PUT /identity/v3/projects/7370285f13064478a29dcc94ea3746b7/users/a54388c338af4ba5a32694b2919a9452/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:41:11.398851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6be8c1-f5d9-42fc-a37a-1649f6511f74 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:11.399438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6be8c1-f5d9-42fc-a37a-1649f6511f74 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:11.399438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6be8c1-f5d9-42fc-a37a-1649f6511f74 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:11.400827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 567/1154] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:11.406812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c33603-96d9-4509-a95f-0808171afee3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:11.407336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c33603-96d9-4509-a95f-0808171afee3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:11.407440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c33603-96d9-4509-a95f-0808171afee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:11.424745 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-70c33603-96d9-4509-a95f-0808171afee3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:11.425912 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-70c33603-96d9-4509-a95f-0808171afee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:11.490659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 588/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:41:11.513438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6be8c1-f5d9-42fc-a37a-1649f6511f74 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:11.613111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6be8c1-f5d9-42fc-a37a-1649f6511f74 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:11.645740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e981c-4a6f-4748-b7fa-8c9e479cbcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:11.646529 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e981c-4a6f-4748-b7fa-8c9e479cbcb6 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:11.646812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e981c-4a6f-4748-b7fa-8c9e479cbcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:11.647113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e981c-4a6f-4748-b7fa-8c9e479cbcb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:11.659010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e981c-4a6f-4748-b7fa-8c9e479cbcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-977e981c-4a6f-4748-b7fa-8c9e479cbcb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:41:11.666440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:41:11.667480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:41:11.668738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 568/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:41:11.673823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c33603-96d9-4509-a95f-0808171afee3 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:11.689578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:11.771335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c33603-96d9-4509-a95f-0808171afee3 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:11.804378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476110f2-2084-4bbe-9b01-51c68349f328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:11.805034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476110f2-2084-4bbe-9b01-51c68349f328 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:11.805313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476110f2-2084-4bbe-9b01-51c68349f328 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:11.805586 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476110f2-2084-4bbe-9b01-51c68349f328 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:11.806323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476110f2-2084-4bbe-9b01-51c68349f328 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:11.806626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476110f2-2084-4bbe-9b01-51c68349f328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:11.808017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476110f2-2084-4bbe-9b01-51c68349f328 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:11.815944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 589/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:11.821611 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e981c-4a6f-4748-b7fa-8c9e479cbcb6 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:11.834594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:11.919225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e981c-4a6f-4748-b7fa-8c9e479cbcb6 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:11.960035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb29288-831a-413c-b44a-950358a12e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:11.960901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb29288-831a-413c-b44a-950358a12e8d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:11.961181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb29288-831a-413c-b44a-950358a12e8d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:11.961455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb29288-831a-413c-b44a-950358a12e8d None admin] PATH_INFO: `/v3/users/a54388c338af4ba5a32694b2919a9452` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:11.962622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb29288-831a-413c-b44a-950358a12e8d None admin] RBAC: Authorizing `identity:get_user(user_id=a54388c338af4ba5a32694b2919a9452)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:11.964080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb29288-831a-413c-b44a-950358a12e8d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:11.965704 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 569/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:41:11 2022] GET /identity/v3/users/a54388c338af4ba5a32694b2919a9452 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:11.972034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476110f2-2084-4bbe-9b01-51c68349f328 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:12.047459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:12.070508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476110f2-2084-4bbe-9b01-51c68349f328 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:12.103993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35935587-ee81-48ae-bbb0-c3743496ac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:12.104630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35935587-ee81-48ae-bbb0-c3743496ac10 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:12.104908 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35935587-ee81-48ae-bbb0-c3743496ac10 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:12.105183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35935587-ee81-48ae-bbb0-c3743496ac10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:12.170098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35935587-ee81-48ae-bbb0-c3743496ac10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:12.171541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35935587-ee81-48ae-bbb0-c3743496ac10 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:12.243024 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:12.266405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 590/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:41:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:41:12.272399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb29288-831a-413c-b44a-950358a12e8d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:12.356910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:12.378306 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb29288-831a-413c-b44a-950358a12e8d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:12.411620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca42a-073f-417c-ab22-464e14c6fe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:12.412472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca42a-073f-417c-ab22-464e14c6fe8d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:12.412751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca42a-073f-417c-ab22-464e14c6fe8d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:12.413025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca42a-073f-417c-ab22-464e14c6fe8d None admin] PATH_INFO: `/v3/projects/7370285f13064478a29dcc94ea3746b7` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:12.414181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ca42a-073f-417c-ab22-464e14c6fe8d None admin] RBAC: Authorizing `identity:get_project(project_id=7370285f13064478a29dcc94ea3746b7)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:12.415648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ca42a-073f-417c-ab22-464e14c6fe8d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:12.417326 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 570/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:41:12 2022] GET /identity/v3/projects/7370285f13064478a29dcc94ea3746b7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:12.424184 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35935587-ee81-48ae-bbb0-c3743496ac10 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:12.518268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35935587-ee81-48ae-bbb0-c3743496ac10 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:12.550891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633f355-f1bd-4999-8e7f-4a2ad995e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:12.551813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f355-f1bd-4999-8e7f-4a2ad995e4ae None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:12.552089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f355-f1bd-4999-8e7f-4a2ad995e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:12.552362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f355-f1bd-4999-8e7f-4a2ad995e4ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:12.553201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633f355-f1bd-4999-8e7f-4a2ad995e4ae None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=7370285f13064478a29dcc94ea3746b7, user.id=a54388c338af4ba5a32694b2919a9452) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:12.553505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633f355-f1bd-4999-8e7f-4a2ad995e4ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:12.554912 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633f355-f1bd-4999-8e7f-4a2ad995e4ae None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:12.561215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 591/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:41:12 2022] GET /identity/v3/role_assignments?user.id=a54388c338af4ba5a32694b2919a9452&scope.project.id=7370285f13064478a29dcc94ea3746b7&role.id=3951cc86a51d416fafc5676d456e79ce => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:14.761335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51375-0df7-4d6e-a5c2-e0ae0449dd7f None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:14.761881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51375-0df7-4d6e-a5c2-e0ae0449dd7f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:14.761881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51375-0df7-4d6e-a5c2-e0ae0449dd7f None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:14.763826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 571/1162] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:14.769342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91682f-5172-4b82-9f62-a8d5b8bf72d9 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:14.769761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91682f-5172-4b82-9f62-a8d5b8bf72d9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:14.769891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91682f-5172-4b82-9f62-a8d5b8bf72d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:14.786839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-af91682f-5172-4b82-9f62-a8d5b8bf72d9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:14.788048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-af91682f-5172-4b82-9f62-a8d5b8bf72d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:14.820640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:14.852525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 592/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:41:14.874390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc51375-0df7-4d6e-a5c2-e0ae0449dd7f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:14.973089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc51375-0df7-4d6e-a5c2-e0ae0449dd7f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:15.005719 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1f4e-cf2a-46b9-a627-b2d28c728489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:15.006356 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1f4e-cf2a-46b9-a627-b2d28c728489 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:15.006642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1f4e-cf2a-46b9-a627-b2d28c728489 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:15.006919 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1f4e-cf2a-46b9-a627-b2d28c728489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:15.021903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:15.071597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1f4e-cf2a-46b9-a627-b2d28c728489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:15.073028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1f4e-cf2a-46b9-a627-b2d28c728489 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:15.167302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 572/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:41:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:41:15.173471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91682f-5172-4b82-9f62-a8d5b8bf72d9 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:15.269913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91682f-5172-4b82-9f62-a8d5b8bf72d9 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:15.302314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26b41a-9c8a-4460-8887-caa0db5d03cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:15.303116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26b41a-9c8a-4460-8887-caa0db5d03cd None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:15.303398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26b41a-9c8a-4460-8887-caa0db5d03cd None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:15.303672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26b41a-9c8a-4460-8887-caa0db5d03cd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:15.310603 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26b41a-9c8a-4460-8887-caa0db5d03cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:15.312065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26b41a-9c8a-4460-8887-caa0db5d03cd None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-bc26b41a-9c8a-4460-8887-caa0db5d03cd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:41:15.326349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:41:15.327549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:41:15.328607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 593/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Fri May 27 13:41:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:41:15.333371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1f4e-cf2a-46b9-a627-b2d28c728489 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:15.378492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:15.431525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1f4e-cf2a-46b9-a627-b2d28c728489 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:15.465144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e36638-f395-45d2-8e27-d7050ea97f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:15.465805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e36638-f395-45d2-8e27-d7050ea97f25 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:15.466089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e36638-f395-45d2-8e27-d7050ea97f25 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:15.466391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e36638-f395-45d2-8e27-d7050ea97f25 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:15.467292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e36638-f395-45d2-8e27-d7050ea97f25 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:15.467605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e36638-f395-45d2-8e27-d7050ea97f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:15.468985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e36638-f395-45d2-8e27-d7050ea97f25 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:15.476011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 573/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Fri May 27 13:41:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:17.654994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b50567-d0e9-4ee4-bd34-c0fa028dbe48 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:17.655549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b50567-d0e9-4ee4-bd34-c0fa028dbe48 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:17.655549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b50567-d0e9-4ee4-bd34-c0fa028dbe48 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:17.656948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 594/1167] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:17.662613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7d036-79d2-49d2-8842-7b03da895a02 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:17.663047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7d036-79d2-49d2-8842-7b03da895a02 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:17.663198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7d036-79d2-49d2-8842-7b03da895a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:17.681012 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-7ea7d036-79d2-49d2-8842-7b03da895a02 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:17.682185 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7ea7d036-79d2-49d2-8842-7b03da895a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:17.747296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 574/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:41:17.773441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b50567-d0e9-4ee4-bd34-c0fa028dbe48 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:17.807435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:17.877242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b50567-d0e9-4ee4-bd34-c0fa028dbe48 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:17.911017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dfea3-9853-4ed1-8b8e-600727f856d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:17.911638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dfea3-9853-4ed1-8b8e-600727f856d1 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:17.911919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dfea3-9853-4ed1-8b8e-600727f856d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:17.912189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dfea3-9853-4ed1-8b8e-600727f856d1 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:17.912926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dfea3-9853-4ed1-8b8e-600727f856d1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:17.914278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dfea3-9853-4ed1-8b8e-600727f856d1 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:18.039035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 595/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Fri May 27 13:41:17 2022] POST /identity/v3/domains => generated 267 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:41:20.256827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69128af2-b081-4b10-bd5a-62b0c8299d1a None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:20.257431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69128af2-b081-4b10-bd5a-62b0c8299d1a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:20.257431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69128af2-b081-4b10-bd5a-62b0c8299d1a None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:20.258755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 575/1170] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:20.264831 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5fed6-8a0c-442b-983d-58b20af9b07c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:20.265254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5fed6-8a0c-442b-983d-58b20af9b07c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:20.265386 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5fed6-8a0c-442b-983d-58b20af9b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:20.282260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-61c5fed6-8a0c-442b-983d-58b20af9b07c None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:20.283455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-61c5fed6-8a0c-442b-983d-58b20af9b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:20.347991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 596/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:41:20.370558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69128af2-b081-4b10-bd5a-62b0c8299d1a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:20.415759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:20.472091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69128af2-b081-4b10-bd5a-62b0c8299d1a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:20.504362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca2d82-ef32-406d-9738-f407f4d83b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:20.505209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca2d82-ef32-406d-9738-f407f4d83b56 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:20.505575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca2d82-ef32-406d-9738-f407f4d83b56 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:20.505850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca2d82-ef32-406d-9738-f407f4d83b56 None admin] PATH_INFO: `/v3/domains/190dc3fde6134fb0aaa5172359e8be9f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:20.516530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca2d82-ef32-406d-9738-f407f4d83b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=190dc3fde6134fb0aaa5172359e8be9f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:20.517908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca2d82-ef32-406d-9738-f407f4d83b56 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:20.519539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 576/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Fri May 27 13:41:20 2022] GET /identity/v3/domains/190dc3fde6134fb0aaa5172359e8be9f => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:20.525261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5fed6-8a0c-442b-983d-58b20af9b07c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:20.545647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:20.620256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5fed6-8a0c-442b-983d-58b20af9b07c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:20.653592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bd53c-2989-46ce-af42-5cfca8e6ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:20.654294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd53c-2989-46ce-af42-5cfca8e6ddf4 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:20.654710 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd53c-2989-46ce-af42-5cfca8e6ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:20.655005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bd53c-2989-46ce-af42-5cfca8e6ddf4 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:20.655707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bd53c-2989-46ce-af42-5cfca8e6ddf4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:20.657136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bd53c-2989-46ce-af42-5cfca8e6ddf4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:20.811490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 597/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:41:20 2022] POST /identity/v3/projects => generated 361 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:41:23.017773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a77e0-d6d6-4a4e-aebe-7a43a41d33e6 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:23.018318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a77e0-d6d6-4a4e-aebe-7a43a41d33e6 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:23.018318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a77e0-d6d6-4a4e-aebe-7a43a41d33e6 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:23.019730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 577/1174] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:23.024867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111c8da-37b6-4b2f-94da-31e32dd6c3e3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:23.025292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111c8da-37b6-4b2f-94da-31e32dd6c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:23.025414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111c8da-37b6-4b2f-94da-31e32dd6c3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:23.042395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a111c8da-37b6-4b2f-94da-31e32dd6c3e3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:23.043591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a111c8da-37b6-4b2f-94da-31e32dd6c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:23.107897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 598/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:41:23.132242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a77e0-d6d6-4a4e-aebe-7a43a41d33e6 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:23.227722 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:23.231399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a77e0-d6d6-4a4e-aebe-7a43a41d33e6 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:23.264669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cabbf-e46c-4c5c-9c1b-36b2939d0b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:23.265514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cabbf-e46c-4c5c-9c1b-36b2939d0b02 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:23.265797 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cabbf-e46c-4c5c-9c1b-36b2939d0b02 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:23.266071 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cabbf-e46c-4c5c-9c1b-36b2939d0b02 None admin] PATH_INFO: `/v3/domains/190dc3fde6134fb0aaa5172359e8be9f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:23.267265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cabbf-e46c-4c5c-9c1b-36b2939d0b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=190dc3fde6134fb0aaa5172359e8be9f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:23.268735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cabbf-e46c-4c5c-9c1b-36b2939d0b02 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:23.270297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 578/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Fri May 27 13:41:23 2022] GET /identity/v3/domains/190dc3fde6134fb0aaa5172359e8be9f => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:23.275938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111c8da-37b6-4b2f-94da-31e32dd6c3e3 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:23.278169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:23.373503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111c8da-37b6-4b2f-94da-31e32dd6c3e3 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:23.406039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbb713-cdc5-47d8-8667-3c52da0f7e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:23.406699 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbb713-cdc5-47d8-8667-3c52da0f7e75 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:23.407000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbb713-cdc5-47d8-8667-3c52da0f7e75 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:23.407282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbb713-cdc5-47d8-8667-3c52da0f7e75 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:23.407985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbb713-cdc5-47d8-8667-3c52da0f7e75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:23.409403 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbb713-cdc5-47d8-8667-3c52da0f7e75 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:23.534758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 599/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:41:23 2022] POST /identity/v3/users => generated 311 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:41:25.755641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2dd28-8e7d-4c1b-a9e8-bfb3bbdff9e4 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:25.756182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2dd28-8e7d-4c1b-a9e8-bfb3bbdff9e4 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:25.756182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2dd28-8e7d-4c1b-a9e8-bfb3bbdff9e4 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:25.757571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 579/1178] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:25.762682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b685-7622-4793-9fcc-dade276a6a01 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:25.763156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b685-7622-4793-9fcc-dade276a6a01 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:25.763296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b685-7622-4793-9fcc-dade276a6a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:25.780516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f969b685-7622-4793-9fcc-dade276a6a01 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:25.781696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f969b685-7622-4793-9fcc-dade276a6a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:25.833035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:25.846752 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 600/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:41:25.870842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2dd28-8e7d-4c1b-a9e8-bfb3bbdff9e4 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:25.970072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2dd28-8e7d-4c1b-a9e8-bfb3bbdff9e4 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:26.002492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc149836-fe6e-4ca9-8154-70f27028bb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:26.003296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc149836-fe6e-4ca9-8154-70f27028bb34 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:26.003579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc149836-fe6e-4ca9-8154-70f27028bb34 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:26.003860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc149836-fe6e-4ca9-8154-70f27028bb34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:26.014430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc149836-fe6e-4ca9-8154-70f27028bb34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-bc149836-fe6e-4ca9-8154-70f27028bb34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:41:26.022001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:41:26.023080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:41:26.024105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 580/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:41:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:41:26.029796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b685-7622-4793-9fcc-dade276a6a01 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:26.124842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b685-7622-4793-9fcc-dade276a6a01 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:26.157910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd59d-03fa-4287-8bfe-f42ddbe4de31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:26.158565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd59d-03fa-4287-8bfe-f42ddbe4de31 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:26.158849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd59d-03fa-4287-8bfe-f42ddbe4de31 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:26.159155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd59d-03fa-4287-8bfe-f42ddbe4de31 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:26.159898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecd59d-03fa-4287-8bfe-f42ddbe4de31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:26.160204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecd59d-03fa-4287-8bfe-f42ddbe4de31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:26.161575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecd59d-03fa-4287-8bfe-f42ddbe4de31 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:26.169352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 601/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:41:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:26.175025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc149836-fe6e-4ca9-8154-70f27028bb34 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:26.203790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:26.273148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc149836-fe6e-4ca9-8154-70f27028bb34 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:26.305223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536fa4-4127-42d1-8cdf-2f56c6d2e357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:26.306078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536fa4-4127-42d1-8cdf-2f56c6d2e357 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:26.306362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536fa4-4127-42d1-8cdf-2f56c6d2e357 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:26.306638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536fa4-4127-42d1-8cdf-2f56c6d2e357 None admin] PATH_INFO: `/v3/users/c1e1ee34145f464daddc5101e6878577` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:26.320222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536fa4-4127-42d1-8cdf-2f56c6d2e357 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e1ee34145f464daddc5101e6878577)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:26.321667 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536fa4-4127-42d1-8cdf-2f56c6d2e357 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:26.323338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 581/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:41:26 2022] GET /identity/v3/users/c1e1ee34145f464daddc5101e6878577 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:26.329767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd59d-03fa-4287-8bfe-f42ddbe4de31 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:26.378873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:26.427435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd59d-03fa-4287-8bfe-f42ddbe4de31 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:26.461874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336706a-568d-48a0-9922-5c8ba1e51589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:26.462523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336706a-568d-48a0-9922-5c8ba1e51589 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:26.462802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336706a-568d-48a0-9922-5c8ba1e51589 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:26.463111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336706a-568d-48a0-9922-5c8ba1e51589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:26.527258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336706a-568d-48a0-9922-5c8ba1e51589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:26.528631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336706a-568d-48a0-9922-5c8ba1e51589 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:26.574914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:26.623455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 602/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:41:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:41:26.629285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536fa4-4127-42d1-8cdf-2f56c6d2e357 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:26.714418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:26.728671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536fa4-4127-42d1-8cdf-2f56c6d2e357 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:26.762307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae80a2-9482-4118-9f09-dcc2d1c2178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:26.763192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae80a2-9482-4118-9f09-dcc2d1c2178b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:26.763475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae80a2-9482-4118-9f09-dcc2d1c2178b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:26.763748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae80a2-9482-4118-9f09-dcc2d1c2178b None admin] PATH_INFO: `/v3/projects/1a58154519aa4ca2afc3b217f70d46b6` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:26.764907 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae80a2-9482-4118-9f09-dcc2d1c2178b None admin] RBAC: Authorizing `identity:get_project(project_id=1a58154519aa4ca2afc3b217f70d46b6)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:26.766334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae80a2-9482-4118-9f09-dcc2d1c2178b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:26.768036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 582/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:41:26 2022] GET /identity/v3/projects/1a58154519aa4ca2afc3b217f70d46b6 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:26.774078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336706a-568d-48a0-9922-5c8ba1e51589 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:26.870175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336706a-568d-48a0-9922-5c8ba1e51589 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:26.902543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db91d34-45c6-4f43-8e04-9247a0ecde71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:26.903198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db91d34-45c6-4f43-8e04-9247a0ecde71 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:26.903479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db91d34-45c6-4f43-8e04-9247a0ecde71 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:26.903748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db91d34-45c6-4f43-8e04-9247a0ecde71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:26.904673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db91d34-45c6-4f43-8e04-9247a0ecde71 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=1a58154519aa4ca2afc3b217f70d46b6, user.id=c1e1ee34145f464daddc5101e6878577) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:26.904978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db91d34-45c6-4f43-8e04-9247a0ecde71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:26.906378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db91d34-45c6-4f43-8e04-9247a0ecde71 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:26.911716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 603/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:41:26 2022] GET /identity/v3/role_assignments?user.id=c1e1ee34145f464daddc5101e6878577&scope.project.id=1a58154519aa4ca2afc3b217f70d46b6&role.id=3951cc86a51d416fafc5676d456e79ce => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:29.077117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522544dd-c82f-488b-a242-af32f7d111cb None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:29.077655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522544dd-c82f-488b-a242-af32f7d111cb None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:29.077655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522544dd-c82f-488b-a242-af32f7d111cb None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:29.079051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 583/1186] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:29.084170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb7cb1-8732-41b7-b0e0-94c8e38dfeb6 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:29.084550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb7cb1-8732-41b7-b0e0-94c8e38dfeb6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:29.084721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb7cb1-8732-41b7-b0e0-94c8e38dfeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:29.101549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-32bb7cb1-8732-41b7-b0e0-94c8e38dfeb6 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:29.102740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-32bb7cb1-8732-41b7-b0e0-94c8e38dfeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:29.111885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:29.167650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 604/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:41:29.190397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522544dd-c82f-488b-a242-af32f7d111cb None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:29.291698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522544dd-c82f-488b-a242-af32f7d111cb None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:29.325944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d23c21-7fad-474c-835f-2ea2bd98b67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:29.327673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d23c21-7fad-474c-835f-2ea2bd98b67e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:29.327905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d23c21-7fad-474c-835f-2ea2bd98b67e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:29.328186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d23c21-7fad-474c-835f-2ea2bd98b67e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:29.338188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d23c21-7fad-474c-835f-2ea2bd98b67e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-31d23c21-7fad-474c-835f-2ea2bd98b67e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:41:29.346420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:41:29.347449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:41:29.348438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 584/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:41:29.353627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb7cb1-8732-41b7-b0e0-94c8e38dfeb6 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:29.450328 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb7cb1-8732-41b7-b0e0-94c8e38dfeb6 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:29.483477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09403e15-bfdf-4483-a7d5-b945c1b8c002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:29.484133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09403e15-bfdf-4483-a7d5-b945c1b8c002 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:29.484414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09403e15-bfdf-4483-a7d5-b945c1b8c002 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:29.484690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09403e15-bfdf-4483-a7d5-b945c1b8c002 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:29.485426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09403e15-bfdf-4483-a7d5-b945c1b8c002 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:29.485732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09403e15-bfdf-4483-a7d5-b945c1b8c002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:29.487128 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09403e15-bfdf-4483-a7d5-b945c1b8c002 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:29.494841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 605/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:41:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:29.501464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d23c21-7fad-474c-835f-2ea2bd98b67e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:29.518162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:29.602369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d23c21-7fad-474c-835f-2ea2bd98b67e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:29.635408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884311b4-45f6-4cd9-9f7b-786286d4f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:29.636279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884311b4-45f6-4cd9-9f7b-786286d4f5e1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:29.636568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884311b4-45f6-4cd9-9f7b-786286d4f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:29.636846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884311b4-45f6-4cd9-9f7b-786286d4f5e1 None admin] PATH_INFO: `/v3/users/c1e1ee34145f464daddc5101e6878577` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:29.638051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884311b4-45f6-4cd9-9f7b-786286d4f5e1 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e1ee34145f464daddc5101e6878577)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:29.640364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884311b4-45f6-4cd9-9f7b-786286d4f5e1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:29.642016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 585/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:41:29 2022] GET /identity/v3/users/c1e1ee34145f464daddc5101e6878577 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:29.647766 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09403e15-bfdf-4483-a7d5-b945c1b8c002 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:29.657177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:29.745361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09403e15-bfdf-4483-a7d5-b945c1b8c002 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:29.777379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71b07a-7ba0-40b5-8ef0-0825fd724f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:29.778221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71b07a-7ba0-40b5-8ef0-0825fd724f74 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:29.778501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71b07a-7ba0-40b5-8ef0-0825fd724f74 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:29.778774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71b07a-7ba0-40b5-8ef0-0825fd724f74 None admin] PATH_INFO: `/v3/projects/1a58154519aa4ca2afc3b217f70d46b6` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:29.780053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71b07a-7ba0-40b5-8ef0-0825fd724f74 None admin] RBAC: Authorizing `identity:get_project(project_id=1a58154519aa4ca2afc3b217f70d46b6)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:29.781479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71b07a-7ba0-40b5-8ef0-0825fd724f74 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:29.783175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 606/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:41:29 2022] GET /identity/v3/projects/1a58154519aa4ca2afc3b217f70d46b6 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:29.789180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884311b4-45f6-4cd9-9f7b-786286d4f5e1 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:29.870017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:29.888095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884311b4-45f6-4cd9-9f7b-786286d4f5e1 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:29.921113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9b8e3-6da1-4e9d-9454-9de92196d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:29.921977 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9b8e3-6da1-4e9d-9454-9de92196d7dc None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:29.922259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9b8e3-6da1-4e9d-9454-9de92196d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:29.922539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9b8e3-6da1-4e9d-9454-9de92196d7dc None admin] PATH_INFO: `/v3/projects/1a58154519aa4ca2afc3b217f70d46b6/users/c1e1ee34145f464daddc5101e6878577/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:29.924499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9b8e3-6da1-4e9d-9454-9de92196d7dc None admin] RBAC: Authorizing `identity:create_grant(project_id=1a58154519aa4ca2afc3b217f70d46b6, user_id=c1e1ee34145f464daddc5101e6878577, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:29.925925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9b8e3-6da1-4e9d-9454-9de92196d7dc None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:30.032514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 586/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:41:29 2022] PUT /identity/v3/projects/1a58154519aa4ca2afc3b217f70d46b6/users/c1e1ee34145f464daddc5101e6878577/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:41:32.207211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab668b-71fb-410f-b7d3-c25e2e3f76d4 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:32.207802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab668b-71fb-410f-b7d3-c25e2e3f76d4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:32.207802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab668b-71fb-410f-b7d3-c25e2e3f76d4 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:32.209212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 607/1193] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:41:32.214352 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7c2c8-20cc-4330-a27d-0cb07d44ef43 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:32.214750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7c2c8-20cc-4330-a27d-0cb07d44ef43 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:32.214911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7c2c8-20cc-4330-a27d-0cb07d44ef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:32.231926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f7a7c2c8-20cc-4330-a27d-0cb07d44ef43 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:41:32.233918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f7a7c2c8-20cc-4330-a27d-0cb07d44ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:41:32.299866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 587/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:41:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:41:32.322872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab668b-71fb-410f-b7d3-c25e2e3f76d4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:32.397752 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:32.422945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab668b-71fb-410f-b7d3-c25e2e3f76d4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:32.455341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748b1eb-624a-405e-8427-fb67c87e33b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:32.456113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748b1eb-624a-405e-8427-fb67c87e33b3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:32.456392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748b1eb-624a-405e-8427-fb67c87e33b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:32.456665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748b1eb-624a-405e-8427-fb67c87e33b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:32.466431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748b1eb-624a-405e-8427-fb67c87e33b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-5748b1eb-624a-405e-8427-fb67c87e33b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:41:32.474602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:41:32.475797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:41:32.476716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 608/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:41:32.481808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7c2c8-20cc-4330-a27d-0cb07d44ef43 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:32.550077 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:32.578593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7c2c8-20cc-4330-a27d-0cb07d44ef43 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:32.612322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29402324-6a63-4087-8808-3ab86f3193db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:32.612978 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402324-6a63-4087-8808-3ab86f3193db None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:32.613259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402324-6a63-4087-8808-3ab86f3193db None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:32.613532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29402324-6a63-4087-8808-3ab86f3193db None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:32.614294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29402324-6a63-4087-8808-3ab86f3193db None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:32.614833 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29402324-6a63-4087-8808-3ab86f3193db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:32.616837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29402324-6a63-4087-8808-3ab86f3193db None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:32.624957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 588/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:32.630621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748b1eb-624a-405e-8427-fb67c87e33b3 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:32.728309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748b1eb-624a-405e-8427-fb67c87e33b3 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:32.759864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65c1f-d11e-4937-b82c-f51b835c80a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:32.760711 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65c1f-d11e-4937-b82c-f51b835c80a0 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:32.760989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65c1f-d11e-4937-b82c-f51b835c80a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:32.761258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65c1f-d11e-4937-b82c-f51b835c80a0 None admin] PATH_INFO: `/v3/users/c1e1ee34145f464daddc5101e6878577` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:32.762409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d65c1f-d11e-4937-b82c-f51b835c80a0 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e1ee34145f464daddc5101e6878577)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:32.764453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d65c1f-d11e-4937-b82c-f51b835c80a0 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:32.766061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 609/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri May 27 13:41:32 2022] GET /identity/v3/users/c1e1ee34145f464daddc5101e6878577 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:32.771765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29402324-6a63-4087-8808-3ab86f3193db None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:32.870984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29402324-6a63-4087-8808-3ab86f3193db None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:32.903923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ad147-e6ac-4127-be98-a9e7c10efc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:32.906040 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ad147-e6ac-4127-be98-a9e7c10efc46 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:32.906317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ad147-e6ac-4127-be98-a9e7c10efc46 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:32.906592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ad147-e6ac-4127-be98-a9e7c10efc46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:32.909602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:32.977686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ad147-e6ac-4127-be98-a9e7c10efc46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:32.979223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ad147-e6ac-4127-be98-a9e7c10efc46 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:33.074706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 589/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:41:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:41:33.082433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65c1f-d11e-4937-b82c-f51b835c80a0 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:33.085312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:33.179017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65c1f-d11e-4937-b82c-f51b835c80a0 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:33.212123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a446b-87b6-4192-a4a1-0d9fb5799e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:33.212961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a446b-87b6-4192-a4a1-0d9fb5799e9c None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:33.213239 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a446b-87b6-4192-a4a1-0d9fb5799e9c None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:33.213509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a446b-87b6-4192-a4a1-0d9fb5799e9c None admin] PATH_INFO: `/v3/projects/1a58154519aa4ca2afc3b217f70d46b6` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:33.214652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a446b-87b6-4192-a4a1-0d9fb5799e9c None admin] RBAC: Authorizing `identity:get_project(project_id=1a58154519aa4ca2afc3b217f70d46b6)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:33.216100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2a446b-87b6-4192-a4a1-0d9fb5799e9c None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:33.217851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 610/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Fri May 27 13:41:33 2022] GET /identity/v3/projects/1a58154519aa4ca2afc3b217f70d46b6 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:33.223902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ad147-e6ac-4127-be98-a9e7c10efc46 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:41:33.265179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:33.332565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ad147-e6ac-4127-be98-a9e7c10efc46 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:41:33.364795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc1322-9c07-425c-9bea-b3c0ef873a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:41:33.365445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc1322-9c07-425c-9bea-b3c0ef873a2c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:41:33.365729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc1322-9c07-425c-9bea-b3c0ef873a2c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:41:33.366003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc1322-9c07-425c-9bea-b3c0ef873a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:41:33.366826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc1322-9c07-425c-9bea-b3c0ef873a2c None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=1a58154519aa4ca2afc3b217f70d46b6, user.id=c1e1ee34145f464daddc5101e6878577) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:41:33.367164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc1322-9c07-425c-9bea-b3c0ef873a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:41:33.368592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc1322-9c07-425c-9bea-b3c0ef873a2c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:41:33.374865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 590/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:41:33 2022] GET /identity/v3/role_assignments?user.id=c1e1ee34145f464daddc5101e6878577&scope.project.id=1a58154519aa4ca2afc3b217f70d46b6&role.id=3951cc86a51d416fafc5676d456e79ce => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:41:43.208116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=65 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:41:43.371699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=51 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:42:59.304335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43ac28-cb6a-4031-ab84-9668c240591e None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:42:59.304977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43ac28-cb6a-4031-ab84-9668c240591e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:42:59.304977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43ac28-cb6a-4031-ab84-9668c240591e None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:42:59.306337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 611/1201] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:42:59.312231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bbd0d-cab2-4eaa-ab8e-fbf33d9a7b44 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:42:59.312669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bbd0d-cab2-4eaa-ab8e-fbf33d9a7b44 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:42:59.312788 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bbd0d-cab2-4eaa-ab8e-fbf33d9a7b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:42:59.329360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-2c0bbd0d-cab2-4eaa-ab8e-fbf33d9a7b44 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:42:59.330544 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2c0bbd0d-cab2-4eaa-ab8e-fbf33d9a7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:42:59.398123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 591/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:42:59.423878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43ac28-cb6a-4031-ab84-9668c240591e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:42:59.527020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43ac28-cb6a-4031-ab84-9668c240591e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:42:59.561964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e1ccd-c5cc-4d0a-8b64-77128dcd0de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:42:59.562731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e1ccd-c5cc-4d0a-8b64-77128dcd0de7 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:42:59.563039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e1ccd-c5cc-4d0a-8b64-77128dcd0de7 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:42:59.563314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e1ccd-c5cc-4d0a-8b64-77128dcd0de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:42:59.573113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e1ccd-c5cc-4d0a-8b64-77128dcd0de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:42:59.585230 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e1ccd-c5cc-4d0a-8b64-77128dcd0de7 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-999e1ccd-c5cc-4d0a-8b64-77128dcd0de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:42:59.592901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:42:59.593994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:42:59.595418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:42:59.595418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:42:59.595418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:42:59.595418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:42:59.595418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 612/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:42:59.600151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bbd0d-cab2-4eaa-ab8e-fbf33d9a7b44 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:42:59.700599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bbd0d-cab2-4eaa-ab8e-fbf33d9a7b44 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:42:59.727813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:42:59.733678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8f0d1-3d3f-4a3b-b645-7433a1f36e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:42:59.734330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8f0d1-3d3f-4a3b-b645-7433a1f36e62 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:42:59.734616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8f0d1-3d3f-4a3b-b645-7433a1f36e62 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:42:59.734929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8f0d1-3d3f-4a3b-b645-7433a1f36e62 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:42:59.735745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8f0d1-3d3f-4a3b-b645-7433a1f36e62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:42:59.736052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8f0d1-3d3f-4a3b-b645-7433a1f36e62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:42:59.737471 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8f0d1-3d3f-4a3b-b645-7433a1f36e62 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:42:59.748928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 592/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:42:59.754674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e1ccd-c5cc-4d0a-8b64-77128dcd0de7 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:42:59.807231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:42:59.852617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e1ccd-c5cc-4d0a-8b64-77128dcd0de7 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:42:59.885061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9666d5-f004-4ee5-bd0b-1afcd3fc4189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:42:59.885715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9666d5-f004-4ee5-bd0b-1afcd3fc4189 None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:42:59.885997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9666d5-f004-4ee5-bd0b-1afcd3fc4189 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:42:59.886270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9666d5-f004-4ee5-bd0b-1afcd3fc4189 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:42:59.886991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9666d5-f004-4ee5-bd0b-1afcd3fc4189 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:42:59.889101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9666d5-f004-4ee5-bd0b-1afcd3fc4189 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:42:59.997469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 613/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Fri May 27 13:42:59 2022] POST /identity/v3/users => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:43:02.225924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c38fb-74b5-46b4-a84f-c3dac1bf848f None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:02.226526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c38fb-74b5-46b4-a84f-c3dac1bf848f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:02.226526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c38fb-74b5-46b4-a84f-c3dac1bf848f None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:02.227899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 593/1206] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:43:02.233212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17897533-4120-46c9-9d4b-b926dcf18157 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:02.233623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17897533-4120-46c9-9d4b-b926dcf18157 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:02.233757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17897533-4120-46c9-9d4b-b926dcf18157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:02.251291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-17897533-4120-46c9-9d4b-b926dcf18157 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:43:02.252481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-17897533-4120-46c9-9d4b-b926dcf18157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:43:02.320365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 614/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:43:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 13:43:02.343600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c38fb-74b5-46b4-a84f-c3dac1bf848f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:02.445828 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c38fb-74b5-46b4-a84f-c3dac1bf848f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:02.478204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f878f7-7663-4259-b894-8fa0d3e57995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:02.478932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f878f7-7663-4259-b894-8fa0d3e57995 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:02.479243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f878f7-7663-4259-b894-8fa0d3e57995 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:02.479517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f878f7-7663-4259-b894-8fa0d3e57995 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:02.491204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f878f7-7663-4259-b894-8fa0d3e57995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-d3f878f7-7663-4259-b894-8fa0d3e57995 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:43:02.499435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:02.500566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:02.501594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 594/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:02.506742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17897533-4120-46c9-9d4b-b926dcf18157 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:02.548181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:02.608698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17897533-4120-46c9-9d4b-b926dcf18157 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:02.641221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d187786-4e04-480c-8a12-946a5bc3a648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:02.644305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d187786-4e04-480c-8a12-946a5bc3a648 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:02.644305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d187786-4e04-480c-8a12-946a5bc3a648 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:02.644305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d187786-4e04-480c-8a12-946a5bc3a648 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:02.644305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d187786-4e04-480c-8a12-946a5bc3a648 None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:02.644305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d187786-4e04-480c-8a12-946a5bc3a648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:02.644829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d187786-4e04-480c-8a12-946a5bc3a648 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:02.653828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 615/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:02.659512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f878f7-7663-4259-b894-8fa0d3e57995 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:02.709533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:02.758778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f878f7-7663-4259-b894-8fa0d3e57995 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:02.792626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbd6cc-0422-4823-9432-76280cfe03ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:02.793429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbd6cc-0422-4823-9432-76280cfe03ba None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:02.793708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbd6cc-0422-4823-9432-76280cfe03ba None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:02.793981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbd6cc-0422-4823-9432-76280cfe03ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:02.803863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbd6cc-0422-4823-9432-76280cfe03ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:02.805316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbd6cc-0422-4823-9432-76280cfe03ba None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-f5fbd6cc-0422-4823-9432-76280cfe03ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:02.822583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:02.823644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:02.824574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:02.824574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:02.824574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:02.824574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:02.824574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 595/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:02.830133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d187786-4e04-480c-8a12-946a5bc3a648 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:02.929473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:02.932418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d187786-4e04-480c-8a12-946a5bc3a648 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:02.966139 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea368-b5f4-4a35-9e58-d047c3e0f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:02.966809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea368-b5f4-4a35-9e58-d047c3e0f5a1 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:02.967115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea368-b5f4-4a35-9e58-d047c3e0f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:02.967393 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ea368-b5f4-4a35-9e58-d047c3e0f5a1 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:02.968103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea368-b5f4-4a35-9e58-d047c3e0f5a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:02.968410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea368-b5f4-4a35-9e58-d047c3e0f5a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:02.969765 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ea368-b5f4-4a35-9e58-d047c3e0f5a1 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:02.980580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 616/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:43:02.987847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbd6cc-0422-4823-9432-76280cfe03ba None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:03.086005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbd6cc-0422-4823-9432-76280cfe03ba None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:03.087510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:03.119836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b9661-260d-476c-bea5-45df538e5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:03.122504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b9661-260d-476c-bea5-45df538e5736 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:03.122504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b9661-260d-476c-bea5-45df538e5736 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:03.122504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b9661-260d-476c-bea5-45df538e5736 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:03.128263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b9661-260d-476c-bea5-45df538e5736 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:03.129707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b9661-260d-476c-bea5-45df538e5736 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-db5b9661-260d-476c-bea5-45df538e5736 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:43:03.144650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:03.145816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:03.146953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 596/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:03.151664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea368-b5f4-4a35-9e58-d047c3e0f5a1 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:03.251040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ea368-b5f4-4a35-9e58-d047c3e0f5a1 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:03.284729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2039c3-0d88-4a55-a84c-7f262dc74bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:03.285397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2039c3-0d88-4a55-a84c-7f262dc74bb2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:03.285679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2039c3-0d88-4a55-a84c-7f262dc74bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:03.285954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2039c3-0d88-4a55-a84c-7f262dc74bb2 None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:03.286778 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2039c3-0d88-4a55-a84c-7f262dc74bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:03.287117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2039c3-0d88-4a55-a84c-7f262dc74bb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:03.288548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2039c3-0d88-4a55-a84c-7f262dc74bb2 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:03.305499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 617/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Fri May 27 13:43:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:03.311823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b9661-260d-476c-bea5-45df538e5736 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:03.411375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b9661-260d-476c-bea5-45df538e5736 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:03.444187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbd3c3-61b8-46da-a181-8f6f5ad35d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:03.444825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbd3c3-61b8-46da-a181-8f6f5ad35d62 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:03.445108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbd3c3-61b8-46da-a181-8f6f5ad35d62 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:03.445383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbd3c3-61b8-46da-a181-8f6f5ad35d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:03.474662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:03.511127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbd3c3-61b8-46da-a181-8f6f5ad35d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:03.513331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbd3c3-61b8-46da-a181-8f6f5ad35d62 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:03.611634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 597/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:43:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:43:03.617630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2039c3-0d88-4a55-a84c-7f262dc74bb2 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:03.636862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:03.719071 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2039c3-0d88-4a55-a84c-7f262dc74bb2 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:03.751926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8af6d8-7f12-451e-a0a2-06958ae68672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:03.752709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8af6d8-7f12-451e-a0a2-06958ae68672 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:03.753014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8af6d8-7f12-451e-a0a2-06958ae68672 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:03.753343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8af6d8-7f12-451e-a0a2-06958ae68672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:03.764694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8af6d8-7f12-451e-a0a2-06958ae68672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:03.766179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8af6d8-7f12-451e-a0a2-06958ae68672 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-6e8af6d8-7f12-451e-a0a2-06958ae68672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:03.783945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:03.785170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:03.786268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:03.786268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:03.786268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:03.786268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:03.786268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 618/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:03.791208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbd3c3-61b8-46da-a181-8f6f5ad35d62 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:03.855297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:03.894253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbd3c3-61b8-46da-a181-8f6f5ad35d62 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:03.926997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d632b-e297-4732-a34c-7671f859beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:03.927605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d632b-e297-4732-a34c-7671f859beb8 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:03.927888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d632b-e297-4732-a34c-7671f859beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:03.928161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d632b-e297-4732-a34c-7671f859beb8 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:03.929142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d632b-e297-4732-a34c-7671f859beb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:03.929444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d632b-e297-4732-a34c-7671f859beb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:03.930817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d632b-e297-4732-a34c-7671f859beb8 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:03.942284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 598/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:03.947838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8af6d8-7f12-451e-a0a2-06958ae68672 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:04.017485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:04.046750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8af6d8-7f12-451e-a0a2-06958ae68672 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:04.080089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9187d0-dfac-4e3d-845e-ffaa3c7076e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:04.080867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9187d0-dfac-4e3d-845e-ffaa3c7076e2 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:04.081150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9187d0-dfac-4e3d-845e-ffaa3c7076e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:04.081426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9187d0-dfac-4e3d-845e-ffaa3c7076e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:04.087878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9187d0-dfac-4e3d-845e-ffaa3c7076e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:04.089324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9187d0-dfac-4e3d-845e-ffaa3c7076e2 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ed9187d0-dfac-4e3d-845e-ffaa3c7076e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:43:04.102686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:04.105455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:04.107308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:43:04.107308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:43:04.107308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:43:04.107308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:43:04.107308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:43:04.107308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:43:04.107308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:04.107308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:04.107308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 619/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:43:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:04.111129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d632b-e297-4732-a34c-7671f859beb8 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:04.227412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d632b-e297-4732-a34c-7671f859beb8 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:04.250359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:04.261515 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242c402-aa59-4912-9c97-7f5ae93d1cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:04.262277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242c402-aa59-4912-9c97-7f5ae93d1cd0 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:04.262807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242c402-aa59-4912-9c97-7f5ae93d1cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:04.263174 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242c402-aa59-4912-9c97-7f5ae93d1cd0 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:04.263981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242c402-aa59-4912-9c97-7f5ae93d1cd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:04.264295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242c402-aa59-4912-9c97-7f5ae93d1cd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:04.265788 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242c402-aa59-4912-9c97-7f5ae93d1cd0 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:04.278284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 599/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:04.284424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9187d0-dfac-4e3d-845e-ffaa3c7076e2 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:04.382825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9187d0-dfac-4e3d-845e-ffaa3c7076e2 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:04.410518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:04.415912 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2ad10-96a9-436b-852e-c2bd55e34922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:04.427025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2ad10-96a9-436b-852e-c2bd55e34922 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:04.427025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2ad10-96a9-436b-852e-c2bd55e34922 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:04.427025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2ad10-96a9-436b-852e-c2bd55e34922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:04.427025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2ad10-96a9-436b-852e-c2bd55e34922 None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=b6375aed65de46e19a9d3da583b42bbd) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:04.427025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2ad10-96a9-436b-852e-c2bd55e34922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:04.427025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2ad10-96a9-436b-852e-c2bd55e34922 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:04.427550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 620/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:43:04 2022] GET /identity/v3/role_assignments?user.id=b6375aed65de46e19a9d3da583b42bbd&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:43:06.598114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851f156-6945-43c4-a481-56654854ff32 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:06.598715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851f156-6945-43c4-a481-56654854ff32 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:06.598715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851f156-6945-43c4-a481-56654854ff32 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:06.600105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 600/1220] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:43:06.605223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fb18a-78a2-48b4-838d-d2603d598e73 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:06.605647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fb18a-78a2-48b4-838d-d2603d598e73 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:06.605788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fb18a-78a2-48b4-838d-d2603d598e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:06.623258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-901fb18a-78a2-48b4-838d-d2603d598e73 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:43:06.624508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-901fb18a-78a2-48b4-838d-d2603d598e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:43:06.693457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 621/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:43:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:43:06.716599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851f156-6945-43c4-a481-56654854ff32 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:06.819061 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851f156-6945-43c4-a481-56654854ff32 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:06.854688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a09af-c9b0-4dcc-84de-47ee2b12be57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:06.855461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a09af-c9b0-4dcc-84de-47ee2b12be57 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:06.855847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a09af-c9b0-4dcc-84de-47ee2b12be57 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:06.856355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a09af-c9b0-4dcc-84de-47ee2b12be57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:06.867413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a09af-c9b0-4dcc-84de-47ee2b12be57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-664a09af-c9b0-4dcc-84de-47ee2b12be57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:43:06.875986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:06.877211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:06.878202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 601/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:43:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:06.883375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fb18a-78a2-48b4-838d-d2603d598e73 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:06.981399 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fb18a-78a2-48b4-838d-d2603d598e73 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:07.004623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:07.015755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e14ff-d3d8-4728-9e66-cef67336a163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:07.016420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e14ff-d3d8-4728-9e66-cef67336a163 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:07.016703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e14ff-d3d8-4728-9e66-cef67336a163 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:07.016979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e14ff-d3d8-4728-9e66-cef67336a163 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:07.017716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e14ff-d3d8-4728-9e66-cef67336a163 None admin] RBAC: Adding query filter params (name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:07.018022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e14ff-d3d8-4728-9e66-cef67336a163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:07.019486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e14ff-d3d8-4728-9e66-cef67336a163 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:07.027073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 622/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:43:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:07.033127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a09af-c9b0-4dcc-84de-47ee2b12be57 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:07.077007 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:07.131671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a09af-c9b0-4dcc-84de-47ee2b12be57 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:07.164684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15841e-feb1-408f-8587-928e9ade3f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:07.165461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15841e-feb1-408f-8587-928e9ade3f23 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:07.165744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15841e-feb1-408f-8587-928e9ade3f23 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:07.166019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15841e-feb1-408f-8587-928e9ade3f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:07.177027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15841e-feb1-408f-8587-928e9ade3f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:07.178734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15841e-feb1-408f-8587-928e9ade3f23 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-4a15841e-feb1-408f-8587-928e9ade3f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:07.195865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:07.203686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:07.205720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:07.205720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:07.205720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:07.205720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:07.205720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 602/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:07.206342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e14ff-d3d8-4728-9e66-cef67336a163 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:07.304592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e14ff-d3d8-4728-9e66-cef67336a163 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:07.337512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdff3b-5a86-4961-8048-b09d760bb25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:07.338164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdff3b-5a86-4961-8048-b09d760bb25f None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:07.338444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdff3b-5a86-4961-8048-b09d760bb25f None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:07.338719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdff3b-5a86-4961-8048-b09d760bb25f None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:07.339543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdff3b-5a86-4961-8048-b09d760bb25f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:07.339852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdff3b-5a86-4961-8048-b09d760bb25f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:07.341842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdff3b-5a86-4961-8048-b09d760bb25f None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:07.353260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 623/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:07.359344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15841e-feb1-408f-8587-928e9ade3f23 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:07.453953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:07.460443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15841e-feb1-408f-8587-928e9ade3f23 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:07.493498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c30f1-5e4a-4000-80ef-194522e04a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:07.498263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c30f1-5e4a-4000-80ef-194522e04a30 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:07.498263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c30f1-5e4a-4000-80ef-194522e04a30 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:07.498263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c30f1-5e4a-4000-80ef-194522e04a30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:07.502330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c30f1-5e4a-4000-80ef-194522e04a30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:07.503813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c30f1-5e4a-4000-80ef-194522e04a30 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-fe6c30f1-5e4a-4000-80ef-194522e04a30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:43:07.518397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:07.519536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:07.520681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 603/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:07.525341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdff3b-5a86-4961-8048-b09d760bb25f None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:07.571438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:07.623254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdff3b-5a86-4961-8048-b09d760bb25f None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:07.655832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3bb3-c5b4-4d48-833d-a2077aa6412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:07.656495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3bb3-c5b4-4d48-833d-a2077aa6412b None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:07.656779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3bb3-c5b4-4d48-833d-a2077aa6412b None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:07.657123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3bb3-c5b4-4d48-833d-a2077aa6412b None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:07.657960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3bb3-c5b4-4d48-833d-a2077aa6412b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:07.658269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3bb3-c5b4-4d48-833d-a2077aa6412b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:07.659803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3bb3-c5b4-4d48-833d-a2077aa6412b None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:07.677549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 624/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Fri May 27 13:43:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:07.683610 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c30f1-5e4a-4000-80ef-194522e04a30 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:07.783947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c30f1-5e4a-4000-80ef-194522e04a30 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:07.817227 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596659c-ad26-425e-96ca-ed1a6334a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:07.818013 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596659c-ad26-425e-96ca-ed1a6334a501 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:07.818296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596659c-ad26-425e-96ca-ed1a6334a501 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:07.818573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596659c-ad26-425e-96ca-ed1a6334a501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:07.829461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596659c-ad26-425e-96ca-ed1a6334a501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:07.830963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596659c-ad26-425e-96ca-ed1a6334a501 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-d596659c-ad26-425e-96ca-ed1a6334a501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:07.848333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:07.849477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:07.850574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:07.850574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:07.850574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:07.850574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:07.850574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 604/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:07.855265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3bb3-c5b4-4d48-833d-a2077aa6412b None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:07.954617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3bb3-c5b4-4d48-833d-a2077aa6412b None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:07.956984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:07.987906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1d009-e707-487a-8792-544562c98be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:07.988560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1d009-e707-487a-8792-544562c98be4 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:07.988850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1d009-e707-487a-8792-544562c98be4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:07.989125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1d009-e707-487a-8792-544562c98be4 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:07.989835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1d009-e707-487a-8792-544562c98be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:07.990199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1d009-e707-487a-8792-544562c98be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:07.991589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1d009-e707-487a-8792-544562c98be4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:08.004124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 625/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:08.009748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596659c-ad26-425e-96ca-ed1a6334a501 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:08.019624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:08.107393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596659c-ad26-425e-96ca-ed1a6334a501 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:08.139998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cbc83-c529-4377-beef-740780053062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:08.140781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cbc83-c529-4377-beef-740780053062 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:08.141062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cbc83-c529-4377-beef-740780053062 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:08.141335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cbc83-c529-4377-beef-740780053062 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:08.147849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cbc83-c529-4377-beef-740780053062 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:08.149363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cbc83-c529-4377-beef-740780053062 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-433cbc83-c529-4377-beef-740780053062 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:43:08.164101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:08.165130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:08.166231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:43:08.166231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:43:08.166231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:43:08.166231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:43:08.166231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:43:08.166231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:43:08.166231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:08.166231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:08.166231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 605/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:43:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:08.171345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1d009-e707-487a-8792-544562c98be4 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:08.269113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1d009-e707-487a-8792-544562c98be4 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:08.301253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f6d6e-852a-4020-9712-5f37eef1c8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:08.301903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f6d6e-852a-4020-9712-5f37eef1c8b7 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:08.302183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f6d6e-852a-4020-9712-5f37eef1c8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:08.302453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f6d6e-852a-4020-9712-5f37eef1c8b7 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:08.303245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f6d6e-852a-4020-9712-5f37eef1c8b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:08.303817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f6d6e-852a-4020-9712-5f37eef1c8b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:08.305222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f6d6e-852a-4020-9712-5f37eef1c8b7 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:08.317338 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 626/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:43:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:08.323340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cbc83-c529-4377-beef-740780053062 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:08.388712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:08.421431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cbc83-c529-4377-beef-740780053062 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:08.455876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ba2f6-6b43-4e42-8a5d-8a417af5821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:08.456763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ba2f6-6b43-4e42-8a5d-8a417af5821d None admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:08.457045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ba2f6-6b43-4e42-8a5d-8a417af5821d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:08.457322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ba2f6-6b43-4e42-8a5d-8a417af5821d None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/b6375aed65de46e19a9d3da583b42bbd/roles/416e51d61cb34bff89839f6703558c2b` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:08.471202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ba2f6-6b43-4e42-8a5d-8a417af5821d None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=b6375aed65de46e19a9d3da583b42bbd, role_id=416e51d61cb34bff89839f6703558c2b)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:08.476123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ba2f6-6b43-4e42-8a5d-8a417af5821d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:08.574243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 606/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:43:08 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/b6375aed65de46e19a9d3da583b42bbd/roles/416e51d61cb34bff89839f6703558c2b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:43:10.750306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930e95-ae97-4787-94bd-98a5af5548cd None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:10.750868 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930e95-ae97-4787-94bd-98a5af5548cd None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:10.750868 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930e95-ae97-4787-94bd-98a5af5548cd None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:10.752266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 627/1233] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:43:10.757678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e4b53-ce81-4047-9b5f-42314199a692 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:10.758125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e4b53-ce81-4047-9b5f-42314199a692 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:10.758260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e4b53-ce81-4047-9b5f-42314199a692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:10.774496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-867e4b53-ce81-4047-9b5f-42314199a692 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:43:10.775755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-867e4b53-ce81-4047-9b5f-42314199a692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:43:10.842079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 607/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:43:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:43:10.865616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77930e95-ae97-4787-94bd-98a5af5548cd None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:10.890389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:10.966785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77930e95-ae97-4787-94bd-98a5af5548cd None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:10.999622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae9823-4b0f-49fb-b5b9-3c86641287ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:11.000421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae9823-4b0f-49fb-b5b9-3c86641287ba None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:11.000707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae9823-4b0f-49fb-b5b9-3c86641287ba None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:11.000983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae9823-4b0f-49fb-b5b9-3c86641287ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:11.011072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae9823-4b0f-49fb-b5b9-3c86641287ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-86ae9823-4b0f-49fb-b5b9-3c86641287ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:43:11.019515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:11.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:11.021680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 628/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Fri May 27 13:43:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:11.026760 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e4b53-ce81-4047-9b5f-42314199a692 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:11.073234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:11.125605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e4b53-ce81-4047-9b5f-42314199a692 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:11.159687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a06e8-1307-479c-9333-42ba0b8634cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:11.160352 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a06e8-1307-479c-9333-42ba0b8634cc None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:11.160636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a06e8-1307-479c-9333-42ba0b8634cc None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:11.160914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a06e8-1307-479c-9333-42ba0b8634cc None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:11.161660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a06e8-1307-479c-9333-42ba0b8634cc None admin] RBAC: Adding query filter params (name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:11.161966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a06e8-1307-479c-9333-42ba0b8634cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:11.163376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a06e8-1307-479c-9333-42ba0b8634cc None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:11.171729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 608/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Fri May 27 13:43:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:11.177515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae9823-4b0f-49fb-b5b9-3c86641287ba None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:11.261495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:11.278181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae9823-4b0f-49fb-b5b9-3c86641287ba None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:11.311186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3d372-cbfc-41a2-b7bd-1ff38b826fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:11.311964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3d372-cbfc-41a2-b7bd-1ff38b826fc3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:11.312249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3d372-cbfc-41a2-b7bd-1ff38b826fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:11.312523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3d372-cbfc-41a2-b7bd-1ff38b826fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:11.322640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3d372-cbfc-41a2-b7bd-1ff38b826fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:11.324197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3d372-cbfc-41a2-b7bd-1ff38b826fc3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-92b3d372-cbfc-41a2-b7bd-1ff38b826fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:11.341872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:11.342907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:11.344054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:11.344054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:11.344054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:11.344054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:11.344054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 629/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:11.348938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a06e8-1307-479c-9333-42ba0b8634cc None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:11.448284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a06e8-1307-479c-9333-42ba0b8634cc None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:11.457385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:11.483521 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e5d6a-9c22-42cb-a298-6585aec527b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:11.484212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e5d6a-9c22-42cb-a298-6585aec527b5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:11.484495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e5d6a-9c22-42cb-a298-6585aec527b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:11.484770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e5d6a-9c22-42cb-a298-6585aec527b5 None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:11.485488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e5d6a-9c22-42cb-a298-6585aec527b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:11.485795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e5d6a-9c22-42cb-a298-6585aec527b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:11.487184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e5d6a-9c22-42cb-a298-6585aec527b5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:11.498555 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 609/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:11.504438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3d372-cbfc-41a2-b7bd-1ff38b826fc3 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:11.603885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3d372-cbfc-41a2-b7bd-1ff38b826fc3 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:11.636860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8de404-cc01-433a-8739-cf6952765d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:11.638251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8de404-cc01-433a-8739-cf6952765d31 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:11.638532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8de404-cc01-433a-8739-cf6952765d31 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:11.638805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8de404-cc01-433a-8739-cf6952765d31 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:11.641463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:11.646376 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8de404-cc01-433a-8739-cf6952765d31 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:11.647853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8de404-cc01-433a-8739-cf6952765d31 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ee8de404-cc01-433a-8739-cf6952765d31 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:43:11.662463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:11.663641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:11.664915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 630/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:11.670248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e5d6a-9c22-42cb-a298-6585aec527b5 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:11.770196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e5d6a-9c22-42cb-a298-6585aec527b5 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:11.802959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6cb0e-16e1-4974-b482-fe10b21bdfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:11.803910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6cb0e-16e1-4974-b482-fe10b21bdfbf None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:11.804191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6cb0e-16e1-4974-b482-fe10b21bdfbf None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:11.804466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6cb0e-16e1-4974-b482-fe10b21bdfbf None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:11.805288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6cb0e-16e1-4974-b482-fe10b21bdfbf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:11.805594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6cb0e-16e1-4974-b482-fe10b21bdfbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:11.807129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6cb0e-16e1-4974-b482-fe10b21bdfbf None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:11.824498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 610/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Fri May 27 13:43:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:11.830345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8de404-cc01-433a-8739-cf6952765d31 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:11.927930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8de404-cc01-433a-8739-cf6952765d31 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:11.961453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ade82-5290-4255-bacb-a5dfbd4f2eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:11.962088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ade82-5290-4255-bacb-a5dfbd4f2eae None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:11.962371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ade82-5290-4255-bacb-a5dfbd4f2eae None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:11.962646 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ade82-5290-4255-bacb-a5dfbd4f2eae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:12.022917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:12.029249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ade82-5290-4255-bacb-a5dfbd4f2eae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:12.030763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ade82-5290-4255-bacb-a5dfbd4f2eae None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:12.127480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 631/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:43:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 13:43:12.133415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6cb0e-16e1-4974-b482-fe10b21bdfbf None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:12.160891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:12.234001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6cb0e-16e1-4974-b482-fe10b21bdfbf None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:12.266501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fb97e-c21b-418c-ad27-5362148a6bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:12.267305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb97e-c21b-418c-ad27-5362148a6bd5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:12.267586 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb97e-c21b-418c-ad27-5362148a6bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:12.267856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fb97e-c21b-418c-ad27-5362148a6bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:12.279514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fb97e-c21b-418c-ad27-5362148a6bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:12.281005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fb97e-c21b-418c-ad27-5362148a6bd5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-d89fb97e-c21b-418c-ad27-5362148a6bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:12.299315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:12.300445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:12.301552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:12.301552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:12.301552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:12.301552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:12.301552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 611/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:12.306772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ade82-5290-4255-bacb-a5dfbd4f2eae None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:12.399248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:12.405343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ade82-5290-4255-bacb-a5dfbd4f2eae None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:12.440059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b93853-d035-420f-90bc-7c55d2957db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:12.440723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b93853-d035-420f-90bc-7c55d2957db4 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:12.441004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b93853-d035-420f-90bc-7c55d2957db4 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:12.441280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b93853-d035-420f-90bc-7c55d2957db4 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:12.441993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b93853-d035-420f-90bc-7c55d2957db4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:12.442295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b93853-d035-420f-90bc-7c55d2957db4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:12.443696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b93853-d035-420f-90bc-7c55d2957db4 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:12.455107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 632/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:12.460852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fb97e-c21b-418c-ad27-5362148a6bd5 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:12.538078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:12.560021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fb97e-c21b-418c-ad27-5362148a6bd5 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:12.594521 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a347462-3c27-4e04-8c6e-ab29f4c02adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:12.595327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a347462-3c27-4e04-8c6e-ab29f4c02adf None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:12.595607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a347462-3c27-4e04-8c6e-ab29f4c02adf None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:12.595877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a347462-3c27-4e04-8c6e-ab29f4c02adf None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:12.602548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a347462-3c27-4e04-8c6e-ab29f4c02adf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:12.604022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a347462-3c27-4e04-8c6e-ab29f4c02adf None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-3a347462-3c27-4e04-8c6e-ab29f4c02adf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:43:12.617881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:12.621150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:12.622994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:43:12.622994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:43:12.622994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:43:12.622994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:43:12.622994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:43:12.622994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:43:12.622994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:12.622994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:12.622994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 612/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:43:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:12.625937 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b93853-d035-420f-90bc-7c55d2957db4 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:12.724101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b93853-d035-420f-90bc-7c55d2957db4 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:12.757561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969672ad-b9b0-48a8-9e26-3447c5e23011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:12.758209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969672ad-b9b0-48a8-9e26-3447c5e23011 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:12.758488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969672ad-b9b0-48a8-9e26-3447c5e23011 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:12.758758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969672ad-b9b0-48a8-9e26-3447c5e23011 None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:12.759560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969672ad-b9b0-48a8-9e26-3447c5e23011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:12.759864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969672ad-b9b0-48a8-9e26-3447c5e23011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:12.761273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969672ad-b9b0-48a8-9e26-3447c5e23011 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:12.774668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 633/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:12.781582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a347462-3c27-4e04-8c6e-ab29f4c02adf None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:12.882678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a347462-3c27-4e04-8c6e-ab29f4c02adf None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:12.917218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67a02c-6647-4b9f-a26a-78254d5e41c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:12.917871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a02c-6647-4b9f-a26a-78254d5e41c1 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:12.918219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a02c-6647-4b9f-a26a-78254d5e41c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:12.919226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67a02c-6647-4b9f-a26a-78254d5e41c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:12.920146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67a02c-6647-4b9f-a26a-78254d5e41c1 None admin] RBAC: Adding query filter params (role.id=416e51d61cb34bff89839f6703558c2b, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=b6375aed65de46e19a9d3da583b42bbd) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:12.920458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67a02c-6647-4b9f-a26a-78254d5e41c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:12.921930 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67a02c-6647-4b9f-a26a-78254d5e41c1 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:12.927768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 613/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:43:12 2022] GET /identity/v3/role_assignments?user.id=b6375aed65de46e19a9d3da583b42bbd&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=416e51d61cb34bff89839f6703558c2b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:15.166526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c638ce-5206-4662-88c8-4c7061a2030f None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:15.167087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c638ce-5206-4662-88c8-4c7061a2030f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:15.167183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c638ce-5206-4662-88c8-4c7061a2030f None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:15.169210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 634/1247] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:43:15.174637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7576839-1eeb-4215-91ba-d052070800e8 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:15.175154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7576839-1eeb-4215-91ba-d052070800e8 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:15.175247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7576839-1eeb-4215-91ba-d052070800e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:15.180523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:15.192617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-c7576839-1eeb-4215-91ba-d052070800e8 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:43:15.193795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c7576839-1eeb-4215-91ba-d052070800e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:43:15.258422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 614/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:43:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:43:15.282566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c638ce-5206-4662-88c8-4c7061a2030f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:15.301163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:15.387607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c638ce-5206-4662-88c8-4c7061a2030f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:15.421460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c655f-2d70-4cc7-a5f1-ff0b6870f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:15.422164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c655f-2d70-4cc7-a5f1-ff0b6870f0fb None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:15.422449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c655f-2d70-4cc7-a5f1-ff0b6870f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:15.422724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c655f-2d70-4cc7-a5f1-ff0b6870f0fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:15.432989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c655f-2d70-4cc7-a5f1-ff0b6870f0fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-059c655f-2d70-4cc7-a5f1-ff0b6870f0fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:43:15.440996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:15.442512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:15.443560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 635/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:43:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:15.448426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7576839-1eeb-4215-91ba-d052070800e8 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:15.548549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7576839-1eeb-4215-91ba-d052070800e8 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:15.579273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:15.584186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43cbfd-fa52-4f24-a4f6-998a8ed33c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:15.584892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43cbfd-fa52-4f24-a4f6-998a8ed33c9b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:15.585176 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43cbfd-fa52-4f24-a4f6-998a8ed33c9b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:15.585456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43cbfd-fa52-4f24-a4f6-998a8ed33c9b None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:15.586205 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43cbfd-fa52-4f24-a4f6-998a8ed33c9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:15.586512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43cbfd-fa52-4f24-a4f6-998a8ed33c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:15.587958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43cbfd-fa52-4f24-a4f6-998a8ed33c9b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:15.597143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 615/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:15.602889 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c655f-2d70-4cc7-a5f1-ff0b6870f0fb None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:15.681970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:15.704682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c655f-2d70-4cc7-a5f1-ff0b6870f0fb None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:15.737104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2165668-3dec-4c15-bca8-7861d36405dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:15.737883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2165668-3dec-4c15-bca8-7861d36405dc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:15.738165 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2165668-3dec-4c15-bca8-7861d36405dc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:15.738439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2165668-3dec-4c15-bca8-7861d36405dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:15.749220 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2165668-3dec-4c15-bca8-7861d36405dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:15.750680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2165668-3dec-4c15-bca8-7861d36405dc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-a2165668-3dec-4c15-bca8-7861d36405dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:15.767022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:15.768072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:15.769141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:15.769141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:15.769141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:15.769141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:15.769141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 636/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:15.774140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43cbfd-fa52-4f24-a4f6-998a8ed33c9b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:15.875555 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43cbfd-fa52-4f24-a4f6-998a8ed33c9b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:15.908911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aed489-8b58-418e-ac69-e29f0e20600e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:15.909568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed489-8b58-418e-ac69-e29f0e20600e None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:15.909853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed489-8b58-418e-ac69-e29f0e20600e None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:15.910130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aed489-8b58-418e-ac69-e29f0e20600e None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:15.910847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aed489-8b58-418e-ac69-e29f0e20600e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:15.911181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aed489-8b58-418e-ac69-e29f0e20600e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:15.912551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aed489-8b58-418e-ac69-e29f0e20600e None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:15.924838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 616/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:43:15.930707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2165668-3dec-4c15-bca8-7861d36405dc None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:16.028984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2165668-3dec-4c15-bca8-7861d36405dc None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:16.054886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:16.062406 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865659-eacd-4fb6-ba97-50856b5938bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:16.063219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865659-eacd-4fb6-ba97-50856b5938bc None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:16.063502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865659-eacd-4fb6-ba97-50856b5938bc None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:16.063789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865659-eacd-4fb6-ba97-50856b5938bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:16.070948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865659-eacd-4fb6-ba97-50856b5938bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:16.072404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865659-eacd-4fb6-ba97-50856b5938bc None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-ee865659-eacd-4fb6-ba97-50856b5938bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:43:16.086458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:16.087595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:16.088705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 637/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:16.094357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aed489-8b58-418e-ac69-e29f0e20600e None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:16.149126 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:16.193518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aed489-8b58-418e-ac69-e29f0e20600e None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:16.227130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370c6a5-6bb3-4416-ac15-f7e7330a9fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:16.227812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c6a5-6bb3-4416-ac15-f7e7330a9fe5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:16.228084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c6a5-6bb3-4416-ac15-f7e7330a9fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:16.228361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c6a5-6bb3-4416-ac15-f7e7330a9fe5 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:16.229200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370c6a5-6bb3-4416-ac15-f7e7330a9fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:16.229511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370c6a5-6bb3-4416-ac15-f7e7330a9fe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:16.231004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370c6a5-6bb3-4416-ac15-f7e7330a9fe5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:16.248480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 617/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Fri May 27 13:43:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:16.254459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865659-eacd-4fb6-ba97-50856b5938bc None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:16.355024 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865659-eacd-4fb6-ba97-50856b5938bc None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:16.388585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33569d7-10a4-4e7d-ba19-6bd3d0e7634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:16.389224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33569d7-10a4-4e7d-ba19-6bd3d0e7634d None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:16.389507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33569d7-10a4-4e7d-ba19-6bd3d0e7634d None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:16.389784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33569d7-10a4-4e7d-ba19-6bd3d0e7634d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:16.445348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:16.457277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33569d7-10a4-4e7d-ba19-6bd3d0e7634d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:16.458730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33569d7-10a4-4e7d-ba19-6bd3d0e7634d None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:16.555900 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 638/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:43:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:43:16.562621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370c6a5-6bb3-4416-ac15-f7e7330a9fe5 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:16.661934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370c6a5-6bb3-4416-ac15-f7e7330a9fe5 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:16.676038 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:16.698294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4df7-b83c-404e-9ff7-c076c17cd150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:16.698999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4df7-b83c-404e-9ff7-c076c17cd150 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:16.699278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4df7-b83c-404e-9ff7-c076c17cd150 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:16.700177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4df7-b83c-404e-9ff7-c076c17cd150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:16.710047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a4df7-b83c-404e-9ff7-c076c17cd150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:16.711530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a4df7-b83c-404e-9ff7-c076c17cd150 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-684a4df7-b83c-404e-9ff7-c076c17cd150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:16.728340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:16.729265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:16.730199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:16.730199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:16.730199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:16.730199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:16.730199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 618/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:16.735413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33569d7-10a4-4e7d-ba19-6bd3d0e7634d None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:16.821419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:16.833686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33569d7-10a4-4e7d-ba19-6bd3d0e7634d None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:16.865625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bba4fc-33a1-43b2-8206-e58c94a959a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:16.866271 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bba4fc-33a1-43b2-8206-e58c94a959a1 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:16.866556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bba4fc-33a1-43b2-8206-e58c94a959a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:16.866831 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bba4fc-33a1-43b2-8206-e58c94a959a1 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:16.867575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bba4fc-33a1-43b2-8206-e58c94a959a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:16.867880 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bba4fc-33a1-43b2-8206-e58c94a959a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:16.869236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bba4fc-33a1-43b2-8206-e58c94a959a1 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:16.881240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 639/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:16.887640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4df7-b83c-404e-9ff7-c076c17cd150 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:16.987348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4df7-b83c-404e-9ff7-c076c17cd150 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:17.021865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843fd6-fddc-451e-a61e-fb22adb476b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:17.022653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843fd6-fddc-451e-a61e-fb22adb476b5 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:17.022936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843fd6-fddc-451e-a61e-fb22adb476b5 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:17.023246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843fd6-fddc-451e-a61e-fb22adb476b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:17.029919 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53843fd6-fddc-451e-a61e-fb22adb476b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:17.031404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53843fd6-fddc-451e-a61e-fb22adb476b5 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-53843fd6-fddc-451e-a61e-fb22adb476b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:43:17.045423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:17.046511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:17.047470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:43:17.047470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:43:17.047470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:43:17.047470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:43:17.047470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:43:17.047470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:43:17.047470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:17.047470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:17.047470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 619/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:43:17.052505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bba4fc-33a1-43b2-8206-e58c94a959a1 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:17.151590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bba4fc-33a1-43b2-8206-e58c94a959a1 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:17.185991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecc518-f778-4f7e-ac71-4c9deb178aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:17.186619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc518-f778-4f7e-ac71-4c9deb178aea None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:17.186906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc518-f778-4f7e-ac71-4c9deb178aea None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:17.187211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc518-f778-4f7e-ac71-4c9deb178aea None admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:17.187994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecc518-f778-4f7e-ac71-4c9deb178aea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:17.188309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecc518-f778-4f7e-ac71-4c9deb178aea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:17.189736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecc518-f778-4f7e-ac71-4c9deb178aea None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:17.201596 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 640/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:17.207844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843fd6-fddc-451e-a61e-fb22adb476b5 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:17.234213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:17.306663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843fd6-fddc-451e-a61e-fb22adb476b5 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:17.342602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12043a87-e518-44f4-9d58-5da04102eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:17.343286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12043a87-e518-44f4-9d58-5da04102eff7 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:17.343577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12043a87-e518-44f4-9d58-5da04102eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:17.343898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12043a87-e518-44f4-9d58-5da04102eff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:17.344841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12043a87-e518-44f4-9d58-5da04102eff7 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=b6375aed65de46e19a9d3da583b42bbd) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:17.345164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12043a87-e518-44f4-9d58-5da04102eff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:17.346630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12043a87-e518-44f4-9d58-5da04102eff7 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:17.352164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 620/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:43:17 2022] GET /identity/v3/role_assignments?user.id=b6375aed65de46e19a9d3da583b42bbd&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=3951cc86a51d416fafc5676d456e79ce => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:19.531268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5f992-aacd-4ed8-9325-92016615ad60 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:19.531838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5f992-aacd-4ed8-9325-92016615ad60 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:19.531838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5f992-aacd-4ed8-9325-92016615ad60 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:19.533231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 641/1261] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:43:19.538423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac988df4-b8a2-4764-9c98-8a7f10929c34 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:19.538826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac988df4-b8a2-4764-9c98-8a7f10929c34 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:19.539092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac988df4-b8a2-4764-9c98-8a7f10929c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:19.556616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ac988df4-b8a2-4764-9c98-8a7f10929c34 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:43:19.557806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ac988df4-b8a2-4764-9c98-8a7f10929c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:43:19.624197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 621/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:43:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:43:19.646911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5f992-aacd-4ed8-9325-92016615ad60 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:19.658744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:19.747102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5f992-aacd-4ed8-9325-92016615ad60 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:19.780535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5bf16-be94-47cd-9b02-609875019b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:19.787180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5bf16-be94-47cd-9b02-609875019b48 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:19.787180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5bf16-be94-47cd-9b02-609875019b48 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:19.787180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5bf16-be94-47cd-9b02-609875019b48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:19.791819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb5bf16-be94-47cd-9b02-609875019b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-cbb5bf16-be94-47cd-9b02-609875019b48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:43:19.799850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:19.800981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:19.801995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 642/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:43:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:19.807410 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac988df4-b8a2-4764-9c98-8a7f10929c34 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:19.825446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:19.901000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac988df4-b8a2-4764-9c98-8a7f10929c34 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:19.934467 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3042f4-ca04-48a0-8b84-d1cd8832190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:19.935150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3042f4-ca04-48a0-8b84-d1cd8832190c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:19.935432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3042f4-ca04-48a0-8b84-d1cd8832190c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:19.935705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3042f4-ca04-48a0-8b84-d1cd8832190c None admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:19.936444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3042f4-ca04-48a0-8b84-d1cd8832190c None admin] RBAC: Adding query filter params (name=admin) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:19.936746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3042f4-ca04-48a0-8b84-d1cd8832190c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:19.938128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3042f4-ca04-48a0-8b84-d1cd8832190c None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:19.945973 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 622/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:19.952536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5bf16-be94-47cd-9b02-609875019b48 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:20.018787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:20.051210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5bf16-be94-47cd-9b02-609875019b48 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:20.083216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f50fe-0d23-43e5-b85a-ed2b6b4dbdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:20.083983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f50fe-0d23-43e5-b85a-ed2b6b4dbdec None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:20.084259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f50fe-0d23-43e5-b85a-ed2b6b4dbdec None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:20.084546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f50fe-0d23-43e5-b85a-ed2b6b4dbdec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:20.095244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f50fe-0d23-43e5-b85a-ed2b6b4dbdec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:20.096688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f50fe-0d23-43e5-b85a-ed2b6b4dbdec None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-648f50fe-0d23-43e5-b85a-ed2b6b4dbdec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:20.113008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:20.115727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:20.116849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:20.116849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:20.116849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:20.116849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:20.116849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 643/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:20.120118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3042f4-ca04-48a0-8b84-d1cd8832190c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:20.205274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:20.224740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3042f4-ca04-48a0-8b84-d1cd8832190c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:20.258003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c1a20-755a-45e7-a3e1-23bb94f61f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:20.258694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c1a20-755a-45e7-a3e1-23bb94f61f2b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:20.258990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c1a20-755a-45e7-a3e1-23bb94f61f2b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:20.259281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c1a20-755a-45e7-a3e1-23bb94f61f2b None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:20.259995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c1a20-755a-45e7-a3e1-23bb94f61f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:20.260296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c1a20-755a-45e7-a3e1-23bb94f61f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:20.261697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c1a20-755a-45e7-a3e1-23bb94f61f2b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:20.274458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 623/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:20.281587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f50fe-0d23-43e5-b85a-ed2b6b4dbdec None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:20.380640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f50fe-0d23-43e5-b85a-ed2b6b4dbdec None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:20.399658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:20.413520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cae21b-aeb0-4c67-a45e-4e4137f124fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:20.414341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cae21b-aeb0-4c67-a45e-4e4137f124fe None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:20.414619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cae21b-aeb0-4c67-a45e-4e4137f124fe None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:20.414893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cae21b-aeb0-4c67-a45e-4e4137f124fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:20.422883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cae21b-aeb0-4c67-a45e-4e4137f124fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:20.424335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cae21b-aeb0-4c67-a45e-4e4137f124fe None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-54cae21b-aeb0-4c67-a45e-4e4137f124fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:43:20.438661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:20.439803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:20.440940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 644/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:20.445764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c1a20-755a-45e7-a3e1-23bb94f61f2b None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:20.547075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c1a20-755a-45e7-a3e1-23bb94f61f2b None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:20.580627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f09f31-e059-4729-8d1f-eab5102dad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:20.581281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f09f31-e059-4729-8d1f-eab5102dad40 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:20.581560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f09f31-e059-4729-8d1f-eab5102dad40 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:20.581834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f09f31-e059-4729-8d1f-eab5102dad40 None admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:20.582658 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f09f31-e059-4729-8d1f-eab5102dad40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:20.582989 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f09f31-e059-4729-8d1f-eab5102dad40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:20.584415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f09f31-e059-4729-8d1f-eab5102dad40 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:20.593577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:20.601942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 624/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Fri May 27 13:43:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:20.608318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cae21b-aeb0-4c67-a45e-4e4137f124fe None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:20.706884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cae21b-aeb0-4c67-a45e-4e4137f124fe None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:20.741304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b885-8e04-43c0-9b51-8dfff0513c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:20.742086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b885-8e04-43c0-9b51-8dfff0513c3e None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:20.742369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b885-8e04-43c0-9b51-8dfff0513c3e None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:20.742640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5b885-8e04-43c0-9b51-8dfff0513c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:20.753145 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5b885-8e04-43c0-9b51-8dfff0513c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:20.754580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5b885-8e04-43c0-9b51-8dfff0513c3e None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-17c5b885-8e04-43c0-9b51-8dfff0513c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:20.771787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:20.772702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:20.773588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:20.773588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:20.773588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:20.773588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:20.773588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 645/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:20.779552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f09f31-e059-4729-8d1f-eab5102dad40 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:20.876627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f09f31-e059-4729-8d1f-eab5102dad40 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:20.910917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b4e8-eb6c-4221-92df-474c8dfd920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:20.911597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b4e8-eb6c-4221-92df-474c8dfd920d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:20.911877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b4e8-eb6c-4221-92df-474c8dfd920d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:20.912147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b4e8-eb6c-4221-92df-474c8dfd920d None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:20.912859 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b4e8-eb6c-4221-92df-474c8dfd920d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:20.913163 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b4e8-eb6c-4221-92df-474c8dfd920d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:20.914525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b4e8-eb6c-4221-92df-474c8dfd920d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:20.926431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 625/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:20.932284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b885-8e04-43c0-9b51-8dfff0513c3e None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:20.963513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:21.030601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5b885-8e04-43c0-9b51-8dfff0513c3e None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:21.065140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1558d-967d-49fa-aca6-33ca320e68b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:21.065914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1558d-967d-49fa-aca6-33ca320e68b0 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:21.066194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1558d-967d-49fa-aca6-33ca320e68b0 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:21.066464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1558d-967d-49fa-aca6-33ca320e68b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:21.073001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1558d-967d-49fa-aca6-33ca320e68b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:21.075068 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d1558d-967d-49fa-aca6-33ca320e68b0 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-74d1558d-967d-49fa-aca6-33ca320e68b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:43:21.088416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:21.089427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:21.090395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:43:21.090395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:43:21.090395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:43:21.090395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:43:21.090395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:43:21.090395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:43:21.090395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:21.090395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:21.090395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 646/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 13:43:21.095492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b4e8-eb6c-4221-92df-474c8dfd920d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:21.153198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:21.194990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b4e8-eb6c-4221-92df-474c8dfd920d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:21.227748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e2d7b-157a-4b5d-acd5-bdcd9a431495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:21.228403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2d7b-157a-4b5d-acd5-bdcd9a431495 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:21.228687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2d7b-157a-4b5d-acd5-bdcd9a431495 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:21.228965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e2d7b-157a-4b5d-acd5-bdcd9a431495 None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:21.229780 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2d7b-157a-4b5d-acd5-bdcd9a431495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:21.230094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2d7b-157a-4b5d-acd5-bdcd9a431495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:21.231596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e2d7b-157a-4b5d-acd5-bdcd9a431495 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:21.243291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 626/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:21.249974 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1558d-967d-49fa-aca6-33ca320e68b0 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:21.341561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:21.349580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1558d-967d-49fa-aca6-33ca320e68b0 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:21.383154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11af77b-e69c-48c2-b0f4-1ca3b0ba3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:21.384022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af77b-e69c-48c2-b0f4-1ca3b0ba3316 None admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:21.384301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af77b-e69c-48c2-b0f4-1ca3b0ba3316 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:21.384570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11af77b-e69c-48c2-b0f4-1ca3b0ba3316 None admin] PATH_INFO: `/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/b6375aed65de46e19a9d3da583b42bbd/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:21.386474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11af77b-e69c-48c2-b0f4-1ca3b0ba3316 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1b672d903ec47fa925efeeda378fb7f, user_id=b6375aed65de46e19a9d3da583b42bbd, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:21.389538 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11af77b-e69c-48c2-b0f4-1ca3b0ba3316 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:21.614228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 647/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Fri May 27 13:43:21 2022] PUT /identity/v3/projects/e1b672d903ec47fa925efeeda378fb7f/users/b6375aed65de46e19a9d3da583b42bbd/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:43:23.855881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40312e-73a9-4f1b-aaf1-85352651ff17 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:23.856409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40312e-73a9-4f1b-aaf1-85352651ff17 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:23.856409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40312e-73a9-4f1b-aaf1-85352651ff17 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:23.857921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 627/1274] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:43:23.863135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b8c1e-0f35-414d-914c-89cef861e702 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:23.863537 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b8c1e-0f35-414d-914c-89cef861e702 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:23.863694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b8c1e-0f35-414d-914c-89cef861e702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:23.880092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ff0b8c1e-0f35-414d-914c-89cef861e702 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:43:23.881269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ff0b8c1e-0f35-414d-914c-89cef861e702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:43:23.947002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 648/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:43:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:43:23.971527 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40312e-73a9-4f1b-aaf1-85352651ff17 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:24.072408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40312e-73a9-4f1b-aaf1-85352651ff17 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:24.090882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:24.106999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf990c-074f-43cf-9cdd-c50f6b5e962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:24.107773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf990c-074f-43cf-9cdd-c50f6b5e962c None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:24.108055 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf990c-074f-43cf-9cdd-c50f6b5e962c None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:24.108327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf990c-074f-43cf-9cdd-c50f6b5e962c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:24.118081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf990c-074f-43cf-9cdd-c50f6b5e962c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-5caf990c-074f-43cf-9cdd-c50f6b5e962c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 13:43:24.126228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:24.127389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 13:43:24.128421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:24.131113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 628/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Fri May 27 13:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:24.133495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b8c1e-0f35-414d-914c-89cef861e702 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:24.214055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:24.231019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b8c1e-0f35-414d-914c-89cef861e702 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:24.264248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7e4e-86dd-489d-9ad2-a2e7b344ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:24.264906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7e4e-86dd-489d-9ad2-a2e7b344ee35 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:24.265202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7e4e-86dd-489d-9ad2-a2e7b344ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:24.265476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7e4e-86dd-489d-9ad2-a2e7b344ee35 None admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:24.266220 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7e4e-86dd-489d-9ad2-a2e7b344ee35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:24.266527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7e4e-86dd-489d-9ad2-a2e7b344ee35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:24.267918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d7e4e-86dd-489d-9ad2-a2e7b344ee35 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:24.275824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 649/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Fri May 27 13:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:24.281685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf990c-074f-43cf-9cdd-c50f6b5e962c None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:24.378688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf990c-074f-43cf-9cdd-c50f6b5e962c None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:24.414485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044cfc7-8cfa-4369-a295-31ace763063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:24.415303 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044cfc7-8cfa-4369-a295-31ace763063f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:24.415588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044cfc7-8cfa-4369-a295-31ace763063f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:24.415865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044cfc7-8cfa-4369-a295-31ace763063f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:24.426860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044cfc7-8cfa-4369-a295-31ace763063f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:24.428332 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044cfc7-8cfa-4369-a295-31ace763063f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-4044cfc7-8cfa-4369-a295-31ace763063f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:24.445839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:24.446886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:24.448243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:24.448243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:24.448243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:24.448243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:24.448243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 629/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:24.452961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7e4e-86dd-489d-9ad2-a2e7b344ee35 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:24.550595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7e4e-86dd-489d-9ad2-a2e7b344ee35 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:24.584300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccb9fb-1bb0-4066-8694-f108c73b0593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:24.585011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccb9fb-1bb0-4066-8694-f108c73b0593 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:24.585294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccb9fb-1bb0-4066-8694-f108c73b0593 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:24.585563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccb9fb-1bb0-4066-8694-f108c73b0593 None admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:24.586264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccb9fb-1bb0-4066-8694-f108c73b0593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:24.586564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccb9fb-1bb0-4066-8694-f108c73b0593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:24.587956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccb9fb-1bb0-4066-8694-f108c73b0593 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:24.599534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 650/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:24.605147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044cfc7-8cfa-4369-a295-31ace763063f None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:24.636485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:24.704389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044cfc7-8cfa-4369-a295-31ace763063f None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:24.737281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff4a81-9d57-4325-8685-cde389b87e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:24.738070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff4a81-9d57-4325-8685-cde389b87e42 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:24.738349 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff4a81-9d57-4325-8685-cde389b87e42 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:24.738622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff4a81-9d57-4325-8685-cde389b87e42 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:24.745884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff4a81-9d57-4325-8685-cde389b87e42 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:24.747983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff4a81-9d57-4325-8685-cde389b87e42 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-08ff4a81-9d57-4325-8685-cde389b87e42 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 13:43:24.761728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:24.762837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:24.763958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 630/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:24.769135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccb9fb-1bb0-4066-8694-f108c73b0593 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:24.772851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:24.867282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccb9fb-1bb0-4066-8694-f108c73b0593 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:24.899806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03cd56-197a-4c80-bb03-8c4ade13d5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:24.900458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03cd56-197a-4c80-bb03-8c4ade13d5ca None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:24.900737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03cd56-197a-4c80-bb03-8c4ade13d5ca None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:24.901006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03cd56-197a-4c80-bb03-8c4ade13d5ca None admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:24.901822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03cd56-197a-4c80-bb03-8c4ade13d5ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:24.902125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03cd56-197a-4c80-bb03-8c4ade13d5ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:24.904315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03cd56-197a-4c80-bb03-8c4ade13d5ca None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:24.922406 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 651/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Fri May 27 13:43:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:43:24.928097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff4a81-9d57-4325-8685-cde389b87e42 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:25.019332 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:25.029242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff4a81-9d57-4325-8685-cde389b87e42 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:25.061916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bf4ed-e247-421f-a195-36e7ecae4c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:25.062551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bf4ed-e247-421f-a195-36e7ecae4c83 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:25.062830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bf4ed-e247-421f-a195-36e7ecae4c83 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:25.063131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bf4ed-e247-421f-a195-36e7ecae4c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:25.133873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bf4ed-e247-421f-a195-36e7ecae4c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:25.135278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bf4ed-e247-421f-a195-36e7ecae4c83 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:25.225960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:25.237632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 631/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Fri May 27 13:43:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 13:43:25.243697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03cd56-197a-4c80-bb03-8c4ade13d5ca None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:25.304661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:25.341812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03cd56-197a-4c80-bb03-8c4ade13d5ca None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:25.377350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add20ae2-b858-4e15-9d04-b62a73b67ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:25.378172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add20ae2-b858-4e15-9d04-b62a73b67ebd None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:25.378448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add20ae2-b858-4e15-9d04-b62a73b67ebd None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:25.378720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add20ae2-b858-4e15-9d04-b62a73b67ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:25.389057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add20ae2-b858-4e15-9d04-b62a73b67ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:25.390427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add20ae2-b858-4e15-9d04-b62a73b67ebd None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-add20ae2-b858-4e15-9d04-b62a73b67ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 13:43:25.408579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:25.409658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:25.410752 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 13:43:25.410752 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 13:43:25.410752 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 13:43:25.410752 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:25.410752 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 652/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:25.415710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bf4ed-e247-421f-a195-36e7ecae4c83 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:25.514882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bf4ed-e247-421f-a195-36e7ecae4c83 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:25.548671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de8c7-f59e-416c-9388-6aba8bbba31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:25.549320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de8c7-f59e-416c-9388-6aba8bbba31d None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:25.549599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de8c7-f59e-416c-9388-6aba8bbba31d None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:25.549871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8de8c7-f59e-416c-9388-6aba8bbba31d None admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:25.550579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de8c7-f59e-416c-9388-6aba8bbba31d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:25.550885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de8c7-f59e-416c-9388-6aba8bbba31d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:25.552278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8de8c7-f59e-416c-9388-6aba8bbba31d None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:25.564236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 632/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Fri May 27 13:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:25.572515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add20ae2-b858-4e15-9d04-b62a73b67ebd None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:25.666504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add20ae2-b858-4e15-9d04-b62a73b67ebd None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:25.681111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:25.700234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba85b1-de0d-4da0-b38d-cd818efc6ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:25.704247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba85b1-de0d-4da0-b38d-cd818efc6ce3 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:25.704247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba85b1-de0d-4da0-b38d-cd818efc6ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:25.704247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba85b1-de0d-4da0-b38d-cd818efc6ce3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:25.707847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba85b1-de0d-4da0-b38d-cd818efc6ce3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:25.709278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba85b1-de0d-4da0-b38d-cd818efc6ce3 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application [None req-aaba85b1-de0d-4da0-b38d-cd818efc6ce3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 13:43:25.723521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application with Lock( May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:25.724583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:25.725676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 13:43:25.725676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 13:43:25.725676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 13:43:25.725676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 13:43:25.725676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 13:43:25.725676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 13:43:25.725676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 13:43:25.725676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: ERROR keystone.server.flask.application May 27 13:43:25.725676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 653/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Fri May 27 13:43:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:25.731089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de8c7-f59e-416c-9388-6aba8bbba31d None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:25.780059 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:25.828149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8de8c7-f59e-416c-9388-6aba8bbba31d None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:25.861669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1644da3-df5d-4fc1-be7a-29c194c1bb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:25.862331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644da3-df5d-4fc1-be7a-29c194c1bb3a None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:25.862640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644da3-df5d-4fc1-be7a-29c194c1bb3a None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:25.862921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644da3-df5d-4fc1-be7a-29c194c1bb3a None admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:25.863761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1644da3-df5d-4fc1-be7a-29c194c1bb3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:25.864074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1644da3-df5d-4fc1-be7a-29c194c1bb3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:25.865534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1644da3-df5d-4fc1-be7a-29c194c1bb3a None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:25.877821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 633/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Fri May 27 13:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:25.883564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba85b1-de0d-4da0-b38d-cd818efc6ce3 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:25.982922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba85b1-de0d-4da0-b38d-cd818efc6ce3 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:26.016583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e3f0f-53d6-4431-825b-08eca9c4e833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:26.017229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e3f0f-53d6-4431-825b-08eca9c4e833 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:26.017517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e3f0f-53d6-4431-825b-08eca9c4e833 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:26.017797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e3f0f-53d6-4431-825b-08eca9c4e833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:26.018625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e3f0f-53d6-4431-825b-08eca9c4e833 None admin] RBAC: Adding query filter params (role.id=3951cc86a51d416fafc5676d456e79ce, scope.project.id=e1b672d903ec47fa925efeeda378fb7f, user.id=b6375aed65de46e19a9d3da583b42bbd) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:26.018937 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e3f0f-53d6-4431-825b-08eca9c4e833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:26.020392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e3f0f-53d6-4431-825b-08eca9c4e833 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:26.026103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 654/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Fri May 27 13:43:25 2022] GET /identity/v3/role_assignments?user.id=b6375aed65de46e19a9d3da583b42bbd&scope.project.id=e1b672d903ec47fa925efeeda378fb7f&role.id=3951cc86a51d416fafc5676d456e79ce => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:28.235765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2ec41-c404-43ab-b417-99afc2501b4e None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:28.236363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2ec41-c404-43ab-b417-99afc2501b4e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:28.236363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2ec41-c404-43ab-b417-99afc2501b4e None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:28.237698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 634/1288] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:43:28.242851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abfeaa-bc9e-4e2e-a27f-ec150bf4499f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:28.243259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abfeaa-bc9e-4e2e-a27f-ec150bf4499f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:28.243432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abfeaa-bc9e-4e2e-a27f-ec150bf4499f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:28.259913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-40abfeaa-bc9e-4e2e-a27f-ec150bf4499f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:43:28.261075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-40abfeaa-bc9e-4e2e-a27f-ec150bf4499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:43:28.291257 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:28.327632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 655/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:43:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:43:28.350019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2ec41-c404-43ab-b417-99afc2501b4e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:28.449687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2ec41-c404-43ab-b417-99afc2501b4e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:28.460694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:28.483970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade90c85-cc19-4ea0-a4e8-fbc80f39aa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:28.484757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade90c85-cc19-4ea0-a4e8-fbc80f39aa17 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:28.485039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade90c85-cc19-4ea0-a4e8-fbc80f39aa17 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:28.485311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade90c85-cc19-4ea0-a4e8-fbc80f39aa17 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:28.486010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade90c85-cc19-4ea0-a4e8-fbc80f39aa17 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:28.487427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade90c85-cc19-4ea0-a4e8-fbc80f39aa17 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-ade90c85-cc19-4ea0-a4e8-fbc80f39aa17 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:28.499020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:28.500140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:28.501504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 635/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Fri May 27 13:43:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:28.506305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abfeaa-bc9e-4e2e-a27f-ec150bf4499f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:28.604431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abfeaa-bc9e-4e2e-a27f-ec150bf4499f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:28.638390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f27516-2814-46c7-a294-e32be62c1073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:28.639070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f27516-2814-46c7-a294-e32be62c1073 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:28.639351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f27516-2814-46c7-a294-e32be62c1073 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:28.639620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f27516-2814-46c7-a294-e32be62c1073 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:28.640310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f27516-2814-46c7-a294-e32be62c1073 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:28.640609 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f27516-2814-46c7-a294-e32be62c1073 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:28.641963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f27516-2814-46c7-a294-e32be62c1073 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:28.646737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 656/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Fri May 27 13:43:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:28.653312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade90c85-cc19-4ea0-a4e8-fbc80f39aa17 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:28.754578 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade90c85-cc19-4ea0-a4e8-fbc80f39aa17 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:28.788575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4829337a-2a04-4e66-b84e-dd12e9ee655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:28.789273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829337a-2a04-4e66-b84e-dd12e9ee655f None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:28.789565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829337a-2a04-4e66-b84e-dd12e9ee655f None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:28.789841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4829337a-2a04-4e66-b84e-dd12e9ee655f None admin] PATH_INFO: `/v3/services` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:28.790555 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829337a-2a04-4e66-b84e-dd12e9ee655f None admin] RBAC: Adding query filter params (type=placement) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:28.790866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829337a-2a04-4e66-b84e-dd12e9ee655f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:28.792301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4829337a-2a04-4e66-b84e-dd12e9ee655f None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:28.797732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 636/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Fri May 27 13:43:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 13:43:30.988690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4887702-5a3c-4ce0-9728-2c003fbf654c None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:30.995743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4887702-5a3c-4ce0-9728-2c003fbf654c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:30.995743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4887702-5a3c-4ce0-9728-2c003fbf654c None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:30.995743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 657/1293] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:43:30.996032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e989b08-da0d-43e6-ac42-84ab3452b285 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:30.996425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e989b08-da0d-43e6-ac42-84ab3452b285 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:30.996655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e989b08-da0d-43e6-ac42-84ab3452b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:31.013045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-2e989b08-da0d-43e6-ac42-84ab3452b285 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:43:31.014219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2e989b08-da0d-43e6-ac42-84ab3452b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:43:31.044066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:31.080046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 637/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:43:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:43:31.103936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4887702-5a3c-4ce0-9728-2c003fbf654c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:31.134918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:31.203807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4887702-5a3c-4ce0-9728-2c003fbf654c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:31.236693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e27029-fb96-4dfd-91ae-2c5a24ca66ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:31.237346 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e27029-fb96-4dfd-91ae-2c5a24ca66ba None admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:31.237629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e27029-fb96-4dfd-91ae-2c5a24ca66ba None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:31.237898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e27029-fb96-4dfd-91ae-2c5a24ca66ba None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:31.238615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e27029-fb96-4dfd-91ae-2c5a24ca66ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:31.240074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e27029-fb96-4dfd-91ae-2c5a24ca66ba None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:31.403706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 658/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Fri May 27 13:43:31 2022] POST /identity/v3/services => generated 246 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:43:33.621248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb95de-f332-402e-97d7-5087c40d3473 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:33.621975 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb95de-f332-402e-97d7-5087c40d3473 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:33.621975 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb95de-f332-402e-97d7-5087c40d3473 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:33.623222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 638/1296] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:43:33.628380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd95dc-fcea-4b1c-815a-707d57479a20 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:33.628811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd95dc-fcea-4b1c-815a-707d57479a20 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:33.628947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd95dc-fcea-4b1c-815a-707d57479a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:33.646394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b3cd95dc-fcea-4b1c-815a-707d57479a20 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:43:33.647649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b3cd95dc-fcea-4b1c-815a-707d57479a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:43:33.722460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 659/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:43:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:43:33.745321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb95de-f332-402e-97d7-5087c40d3473 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:33.848657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb95de-f332-402e-97d7-5087c40d3473 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:33.882889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efeb40-6c70-4abd-bf16-08edee871974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:33.883640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efeb40-6c70-4abd-bf16-08edee871974 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:33.883921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efeb40-6c70-4abd-bf16-08edee871974 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:33.884189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3efeb40-6c70-4abd-bf16-08edee871974 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:33.884831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efeb40-6c70-4abd-bf16-08edee871974 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:33.886201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3efeb40-6c70-4abd-bf16-08edee871974 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-a3efeb40-6c70-4abd-bf16-08edee871974 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:33.898437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:33.899643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:33.900538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 639/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Fri May 27 13:43:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:33.905773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd95dc-fcea-4b1c-815a-707d57479a20 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:33.924144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:34.004350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd95dc-fcea-4b1c-815a-707d57479a20 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:34.037742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bf37f-930e-4daa-ba08-d9add460e392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:34.038396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf37f-930e-4daa-ba08-d9add460e392 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:34.038675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf37f-930e-4daa-ba08-d9add460e392 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:34.038949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf37f-930e-4daa-ba08-d9add460e392 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:34.039664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bf37f-930e-4daa-ba08-d9add460e392 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:34.039963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bf37f-930e-4daa-ba08-d9add460e392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:34.041311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bf37f-930e-4daa-ba08-d9add460e392 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:34.046554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 660/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Fri May 27 13:43:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:34.052502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efeb40-6c70-4abd-bf16-08edee871974 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:34.085154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:34.151378 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3efeb40-6c70-4abd-bf16-08edee871974 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:34.185548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ee02b-194c-4821-b70f-72d1752b9a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:34.186221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee02b-194c-4821-b70f-72d1752b9a6b None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:34.186509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee02b-194c-4821-b70f-72d1752b9a6b None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:34.186790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee02b-194c-4821-b70f-72d1752b9a6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:34.187617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ee02b-194c-4821-b70f-72d1752b9a6b None admin] RBAC: Adding query filter params (interface=public, service_id=8316646da0e84b7da410890b32f415bb, region_id=RegionOne) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:34.187965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ee02b-194c-4821-b70f-72d1752b9a6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:34.189390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ee02b-194c-4821-b70f-72d1752b9a6b None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:34.194548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 640/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Fri May 27 13:43:34 2022] GET /identity/v3/endpoints?service_id=8316646da0e84b7da410890b32f415bb&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:34.200171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bf37f-930e-4daa-ba08-d9add460e392 None admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:34.280944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:34.298640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bf37f-930e-4daa-ba08-d9add460e392 None admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:34.332409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b13a4b-6473-4d19-a145-db3e9ac8ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:34.333143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b13a4b-6473-4d19-a145-db3e9ac8ed33 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:34.333424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b13a4b-6473-4d19-a145-db3e9ac8ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:34.333698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b13a4b-6473-4d19-a145-db3e9ac8ed33 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:34.334369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b13a4b-6473-4d19-a145-db3e9ac8ed33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:34.335746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b13a4b-6473-4d19-a145-db3e9ac8ed33 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:34.342944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 661/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Fri May 27 13:43:34 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 13:43:36.520178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a444d69-8449-477f-8d7c-755c1af7f714 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:36.520789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a444d69-8449-477f-8d7c-755c1af7f714 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:36.520789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a444d69-8449-477f-8d7c-755c1af7f714 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:36.522135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 641/1302] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:43:36.527741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3045-e37f-457f-8bcd-07b370b2e6c3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:36.528240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3045-e37f-457f-8bcd-07b370b2e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:36.528642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3045-e37f-457f-8bcd-07b370b2e6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:36.545708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-714e3045-e37f-457f-8bcd-07b370b2e6c3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:43:36.546867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-714e3045-e37f-457f-8bcd-07b370b2e6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:43:36.614118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 662/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:43:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 13:43:36.637327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a444d69-8449-477f-8d7c-755c1af7f714 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:36.734097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:36.740765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a444d69-8449-477f-8d7c-755c1af7f714 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:36.774794 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a83eb-1960-4bff-91a8-5667256d6a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:36.775560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a83eb-1960-4bff-91a8-5667256d6a83 None admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:36.775848 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a83eb-1960-4bff-91a8-5667256d6a83 None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:36.776125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a83eb-1960-4bff-91a8-5667256d6a83 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:36.776775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a83eb-1960-4bff-91a8-5667256d6a83 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:36.778468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a83eb-1960-4bff-91a8-5667256d6a83 None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application [None req-1e7a83eb-1960-4bff-91a8-5667256d6a83 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 13:43:36.790342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 13:43:36.791604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.get_or_create( May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application with Lock( May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self._enter() May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application return self.creator() May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application created_value = creator( May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: ERROR keystone.server.flask.application May 27 13:43:36.793296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 642/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Fri May 27 13:43:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 13:43:36.798337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e3045-e37f-457f-8bcd-07b370b2e6c3 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:36.873127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:36.896253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e3045-e37f-457f-8bcd-07b370b2e6c3 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:36.931906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e3b97-c117-4f4f-95df-09898408b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:36.932562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3b97-c117-4f4f-95df-09898408b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:36.932845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3b97-c117-4f4f-95df-09898408b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:36.933162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e3b97-c117-4f4f-95df-09898408b5f1 None admin] PATH_INFO: `/v3/services` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:36.933919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e3b97-c117-4f4f-95df-09898408b5f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:43:36.934199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e3b97-c117-4f4f-95df-09898408b5f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:36.935589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e3b97-c117-4f4f-95df-09898408b5f1 None admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:36.940636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 663/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Fri May 27 13:43:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:43:36.946395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a83eb-1960-4bff-91a8-5667256d6a83 None admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:43:37.046734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a83eb-1960-4bff-91a8-5667256d6a83 None admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:43:37.079471 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b4dce-d030-4dc3-a4d9-0b46a80439bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:43:37.080685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b4dce-d030-4dc3-a4d9-0b46a80439bf None admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:43:37.080685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b4dce-d030-4dc3-a4d9-0b46a80439bf None admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:43:37.080685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b4dce-d030-4dc3-a4d9-0b46a80439bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:43:37.081418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b4dce-d030-4dc3-a4d9-0b46a80439bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:43:37.082783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b4dce-d030-4dc3-a4d9-0b46a80439bf None admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:43:37.197405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 643/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Fri May 27 13:43:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:43:46.937649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=30 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:43:47.192898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:51:48.897014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1c978-67d5-4963-87a2-2ae4883cb804 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:48.897879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1c978-67d5-4963-87a2-2ae4883cb804 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:48.898412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1c978-67d5-4963-87a2-2ae4883cb804 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:48.900682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 664/1307] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:51:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:51:48.907319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302aa14-fe07-4d83-9b5a-32734fe5ad95 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:48.910938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302aa14-fe07-4d83-9b5a-32734fe5ad95 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:48.910938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302aa14-fe07-4d83-9b5a-32734fe5ad95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:48.991487 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a302aa14-fe07-4d83-9b5a-32734fe5ad95 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:51:48.992794 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a302aa14-fe07-4d83-9b5a-32734fe5ad95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:49.117288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 644/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:51:49.177107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d870c-7605-4f91-ad43-27d8bd710995 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:49.177391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d870c-7605-4f91-ad43-27d8bd710995 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:49.177804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d870c-7605-4f91-ad43-27d8bd710995 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:49.179944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 665/1309] 10.222.0.42 () {54 vars in 964 bytes} [Fri May 27 13:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:51:49.195835 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5fcd4-ab9e-4c36-985a-4b9e5f2b7a3b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:49.196744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5fcd4-ab9e-4c36-985a-4b9e5f2b7a3b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:49.197555 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5fcd4-ab9e-4c36-985a-4b9e5f2b7a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:49.298495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-70c5fcd4-ab9e-4c36-985a-4b9e5f2b7a3b None None] MFA Rules not processed for user `7afc19dc502f425faf693eb963fe63d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:51:49.299918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-70c5fcd4-ab9e-4c36-985a-4b9e5f2b7a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:49.329234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:51:49.403368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 645/1310] 10.222.0.42 () {58 vars in 1061 bytes} [Fri May 27 13:51:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:51:49.413873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d870c-7605-4f91-ad43-27d8bd710995 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:51:49.416846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0f6d870c-7605-4f91-ad43-27d8bd710995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:49.577532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d870c-7605-4f91-ad43-27d8bd710995 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:51:49.660223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cd834-94bd-4bf5-b982-1b64ae36834f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:51:49.661047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd834-94bd-4bf5-b982-1b64ae36834f service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:49.661384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd834-94bd-4bf5-b982-1b64ae36834f service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:49.661717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cd834-94bd-4bf5-b982-1b64ae36834f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:49.663452 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6a0cd834-94bd-4bf5-b982-1b64ae36834f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:49.728985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:51:49.788106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cd834-94bd-4bf5-b982-1b64ae36834f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:51:49.789547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cd834-94bd-4bf5-b982-1b64ae36834f service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:51:49.808808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 666/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:51:52.320047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad3232-84e5-4bec-91f3-b15e53533b0e None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:52.320588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad3232-84e5-4bec-91f3-b15e53533b0e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:52.320829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad3232-84e5-4bec-91f3-b15e53533b0e None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:52.322637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 646/1312] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:51:52.329778 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31758-fb5e-4a99-af76-5280689b671f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:52.332815 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31758-fb5e-4a99-af76-5280689b671f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:52.333289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31758-fb5e-4a99-af76-5280689b671f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:52.423052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-31b31758-fb5e-4a99-af76-5280689b671f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:51:52.424501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-31b31758-fb5e-4a99-af76-5280689b671f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:52.530982 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 667/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:51:52.574204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad3232-84e5-4bec-91f3-b15e53533b0e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:51:52.576478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c5ad3232-84e5-4bec-91f3-b15e53533b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:52.698753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad3232-84e5-4bec-91f3-b15e53533b0e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:51:52.779939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:51:52.782858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fdaeb-b113-4133-826e-c132abd63957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:51:52.783763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdaeb-b113-4133-826e-c132abd63957 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:52.784214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdaeb-b113-4133-826e-c132abd63957 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:52.784496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdaeb-b113-4133-826e-c132abd63957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:52.786172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3d5fdaeb-b113-4133-826e-c132abd63957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:52.910809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fdaeb-b113-4133-826e-c132abd63957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:51:52.912348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fdaeb-b113-4133-826e-c132abd63957 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:51:52.933247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 647/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:51:55.839824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e351b-6a26-4638-878b-eedadf3cfb74 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:55.840395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e351b-6a26-4638-878b-eedadf3cfb74 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:55.840395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e351b-6a26-4638-878b-eedadf3cfb74 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:55.842923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 668/1315] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:51:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:51:55.848441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1825e-c154-48bd-8a2c-9936d374c696 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:55.848930 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1825e-c154-48bd-8a2c-9936d374c696 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:55.849039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1825e-c154-48bd-8a2c-9936d374c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:55.917810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a3a1825e-c154-48bd-8a2c-9936d374c696 None None] MFA Rules not processed for user `b34cdcd2c3194a99b2b1075d635e61f4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:51:55.919048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a3a1825e-c154-48bd-8a2c-9936d374c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:55.973068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:51:56.019565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 648/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:51:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:51:56.072930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01cc46-5168-49f6-a304-385a4670f9e6 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:56.073211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01cc46-5168-49f6-a304-385a4670f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:56.073490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01cc46-5168-49f6-a304-385a4670f9e6 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:56.074874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 669/1317] 10.222.0.42 () {54 vars in 964 bytes} [Fri May 27 13:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:51:56.080896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83891907-439e-4660-8422-c6cd3450c754 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:56.081189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83891907-439e-4660-8422-c6cd3450c754 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:56.081468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83891907-439e-4660-8422-c6cd3450c754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:56.167305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-83891907-439e-4660-8422-c6cd3450c754 None None] MFA Rules not processed for user `7afc19dc502f425faf693eb963fe63d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:51:56.169235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-83891907-439e-4660-8422-c6cd3450c754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:56.256044 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 649/1318] 10.222.0.42 () {58 vars in 1061 bytes} [Fri May 27 13:51:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:51:56.266370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01cc46-5168-49f6-a304-385a4670f9e6 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:51:56.267964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3b01cc46-5168-49f6-a304-385a4670f9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:56.277732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:51:56.372957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01cc46-5168-49f6-a304-385a4670f9e6 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:51:56.445267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692be59-a67e-4753-b034-239323d26c26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:51:56.445911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692be59-a67e-4753-b034-239323d26c26 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:51:56.446190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692be59-a67e-4753-b034-239323d26c26 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:51:56.446463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692be59-a67e-4753-b034-239323d26c26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:51:56.448118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9692be59-a67e-4753-b034-239323d26c26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:51:56.508749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:51:56.556476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692be59-a67e-4753-b034-239323d26c26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:51:56.557904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692be59-a67e-4753-b034-239323d26c26 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:51:56.576713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 670/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:51:56 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:00.124312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b75a-6662-4608-99f9-854fbc4974a5 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:00.124862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b75a-6662-4608-99f9-854fbc4974a5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:00.124862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b75a-6662-4608-99f9-854fbc4974a5 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:00.126288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 650/1320] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:00.131600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f7461-88ba-4bf2-8340-85b89a39b1e6 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:00.132009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f7461-88ba-4bf2-8340-85b89a39b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:00.132153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f7461-88ba-4bf2-8340-85b89a39b1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:00.196328 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-955f7461-88ba-4bf2-8340-85b89a39b1e6 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:00.197513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-955f7461-88ba-4bf2-8340-85b89a39b1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:00.291504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 671/1321] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:00.330382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04b75a-6662-4608-99f9-854fbc4974a5 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:00.331976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-6c04b75a-6662-4608-99f9-854fbc4974a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:00.381911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:00.434362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04b75a-6662-4608-99f9-854fbc4974a5 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:00.507528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b212bd4-62ab-4370-ad12-55d5f3c71ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:00.508176 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b212bd4-62ab-4370-ad12-55d5f3c71ccb service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:00.508458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b212bd4-62ab-4370-ad12-55d5f3c71ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:00.508733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b212bd4-62ab-4370-ad12-55d5f3c71ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:00.510384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0b212bd4-62ab-4370-ad12-55d5f3c71ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:00.607787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:00.620394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b212bd4-62ab-4370-ad12-55d5f3c71ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:00.621841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b212bd4-62ab-4370-ad12-55d5f3c71ccb service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:00.639551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 651/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:04.119916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdb80d-4d4d-4c6a-b8e7-31e9c5bca594 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:04.120460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdb80d-4d4d-4c6a-b8e7-31e9c5bca594 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:04.120460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdb80d-4d4d-4c6a-b8e7-31e9c5bca594 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:04.121836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 672/1323] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:04.127554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb8bcd-863e-4dbd-bf53-3241ecc1ce52 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:04.127990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb8bcd-863e-4dbd-bf53-3241ecc1ce52 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:04.128136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb8bcd-863e-4dbd-bf53-3241ecc1ce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:04.192978 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-cabb8bcd-863e-4dbd-bf53-3241ecc1ce52 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:04.194167 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-cabb8bcd-863e-4dbd-bf53-3241ecc1ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:04.289791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 652/1324] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:04.326824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdb80d-4d4d-4c6a-b8e7-31e9c5bca594 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:04.328448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-2bcdb80d-4d4d-4c6a-b8e7-31e9c5bca594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:04.347556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:04.430213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdb80d-4d4d-4c6a-b8e7-31e9c5bca594 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:04.503885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cae67-c1f1-484e-a350-69b60f4dc78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:04.504536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cae67-c1f1-484e-a350-69b60f4dc78c service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:04.504814 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cae67-c1f1-484e-a350-69b60f4dc78c service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:04.505086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cae67-c1f1-484e-a350-69b60f4dc78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:04.506700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cd6cae67-c1f1-484e-a350-69b60f4dc78c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:04.579266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:04.619091 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cae67-c1f1-484e-a350-69b60f4dc78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:04.620761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cae67-c1f1-484e-a350-69b60f4dc78c service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:04.640869 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 673/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:06.936375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255f371-b485-4e2c-b23a-54a723323f49 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:06.936908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255f371-b485-4e2c-b23a-54a723323f49 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:06.936908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255f371-b485-4e2c-b23a-54a723323f49 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:06.938219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 653/1326] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:06.944603 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0932-a9f4-4bd4-89ee-5978e50894f3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:06.945050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0932-a9f4-4bd4-89ee-5978e50894f3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:06.945141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0932-a9f4-4bd4-89ee-5978e50894f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:07.017047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b7df0932-a9f4-4bd4-89ee-5978e50894f3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:07.018498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b7df0932-a9f4-4bd4-89ee-5978e50894f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:07.118386 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 674/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:07.153759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255f371-b485-4e2c-b23a-54a723323f49 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:07.155614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f255f371-b485-4e2c-b23a-54a723323f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:07.217965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:07.261463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255f371-b485-4e2c-b23a-54a723323f49 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:07.340197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce565b64-0043-4673-837c-06b04ab6dcf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:07.340853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce565b64-0043-4673-837c-06b04ab6dcf7 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:07.341139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce565b64-0043-4673-837c-06b04ab6dcf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:07.341417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce565b64-0043-4673-837c-06b04ab6dcf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:07.343145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ce565b64-0043-4673-837c-06b04ab6dcf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:07.451974 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:07.454212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce565b64-0043-4673-837c-06b04ab6dcf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:07.455751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce565b64-0043-4673-837c-06b04ab6dcf7 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:07.475145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 654/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:09.761472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70b2c1-5eed-497f-a70b-3a1a5fc51953 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:09.762009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70b2c1-5eed-497f-a70b-3a1a5fc51953 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:09.762009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70b2c1-5eed-497f-a70b-3a1a5fc51953 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:09.763521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 675/1329] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:09.769744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c81c7-ccde-4622-8f6f-f4839de566f1 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:09.770196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c81c7-ccde-4622-8f6f-f4839de566f1 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:09.770316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c81c7-ccde-4622-8f6f-f4839de566f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:09.837965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-613c81c7-ccde-4622-8f6f-f4839de566f1 None None] MFA Rules not processed for user `b34cdcd2c3194a99b2b1075d635e61f4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:09.839185 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-613c81c7-ccde-4622-8f6f-f4839de566f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:09.936190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 655/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:09.972484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70b2c1-5eed-497f-a70b-3a1a5fc51953 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:09.974007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1e70b2c1-5eed-497f-a70b-3a1a5fc51953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:10.006219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:10.082458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70b2c1-5eed-497f-a70b-3a1a5fc51953 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:10.156746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214865e5-88f4-4801-adaa-87287e72dad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:10.157395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214865e5-88f4-4801-adaa-87287e72dad2 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:10.157678 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214865e5-88f4-4801-adaa-87287e72dad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:10.157954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214865e5-88f4-4801-adaa-87287e72dad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:10.159703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-214865e5-88f4-4801-adaa-87287e72dad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:10.236521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:10.268514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214865e5-88f4-4801-adaa-87287e72dad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:10.269971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214865e5-88f4-4801-adaa-87287e72dad2 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:10.289184 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 676/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:13.097814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab445f0-2062-4a07-9442-57a0d031c6cd None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:13.098327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab445f0-2062-4a07-9442-57a0d031c6cd None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:13.098408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab445f0-2062-4a07-9442-57a0d031c6cd None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:13.099804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 656/1332] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:13.105442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8747-9657-43cc-bd86-d7e371e68a9f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:13.105904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8747-9657-43cc-bd86-d7e371e68a9f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:13.105985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae8747-9657-43cc-bd86-d7e371e68a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:13.176284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ccae8747-9657-43cc-bd86-d7e371e68a9f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:13.177403 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ccae8747-9657-43cc-bd86-d7e371e68a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:13.275273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 677/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:13.312802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab445f0-2062-4a07-9442-57a0d031c6cd None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:13.314419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5ab445f0-2062-4a07-9442-57a0d031c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:13.396571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:13.434109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab445f0-2062-4a07-9442-57a0d031c6cd None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:13.512180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910605b7-7986-4516-a437-0e224a69db63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:13.512847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910605b7-7986-4516-a437-0e224a69db63 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:13.513132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910605b7-7986-4516-a437-0e224a69db63 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:13.513431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910605b7-7986-4516-a437-0e224a69db63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:13.515147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-910605b7-7986-4516-a437-0e224a69db63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:13.631494 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910605b7-7986-4516-a437-0e224a69db63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:13.632945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910605b7-7986-4516-a437-0e224a69db63 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:13.643982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:13.652843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 657/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:15.907562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03246-3f57-4d61-be77-18a3eeda2b0f None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:15.908135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03246-3f57-4d61-be77-18a3eeda2b0f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:15.908135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c03246-3f57-4d61-be77-18a3eeda2b0f None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:15.909556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 678/1335] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:15.914739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63c29-7bc4-4d92-ac3f-421c7ce9c01b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:15.915199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63c29-7bc4-4d92-ac3f-421c7ce9c01b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:15.915401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df63c29-7bc4-4d92-ac3f-421c7ce9c01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:15.982836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4df63c29-7bc4-4d92-ac3f-421c7ce9c01b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:15.984060 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4df63c29-7bc4-4d92-ac3f-421c7ce9c01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:16.081167 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 658/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:16.121067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c03246-3f57-4d61-be77-18a3eeda2b0f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:16.122613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-72c03246-3f57-4d61-be77-18a3eeda2b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:16.161993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:16.224782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c03246-3f57-4d61-be77-18a3eeda2b0f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:16.296891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a3c48-4e62-483b-bb6e-3f6f83e45157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:16.297527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a3c48-4e62-483b-bb6e-3f6f83e45157 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:16.297804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a3c48-4e62-483b-bb6e-3f6f83e45157 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:16.298074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a3c48-4e62-483b-bb6e-3f6f83e45157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:16.299724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a59a3c48-4e62-483b-bb6e-3f6f83e45157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:16.380999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:16.406383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a3c48-4e62-483b-bb6e-3f6f83e45157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:16.407979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a3c48-4e62-483b-bb6e-3f6f83e45157 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:16.426580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 679/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:19.554379 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d55398-e790-4601-8d63-7a64222ceac5 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:19.558078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d55398-e790-4601-8d63-7a64222ceac5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:19.558078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d55398-e790-4601-8d63-7a64222ceac5 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:19.558078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 659/1338] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:19.562258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8dc82-895b-4772-80db-3d00fb8ea2d6 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:19.562677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8dc82-895b-4772-80db-3d00fb8ea2d6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:19.562812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8dc82-895b-4772-80db-3d00fb8ea2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:19.632197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-44e8dc82-895b-4772-80db-3d00fb8ea2d6 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:19.633393 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-44e8dc82-895b-4772-80db-3d00fb8ea2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:19.738358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 680/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:19.773843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d55398-e790-4601-8d63-7a64222ceac5 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:19.776139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-64d55398-e790-4601-8d63-7a64222ceac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:19.855806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:19.870513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d55398-e790-4601-8d63-7a64222ceac5 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:19.874609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dd12c-23bb-48ec-b99a-69132bc5ee6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:19.875281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dd12c-23bb-48ec-b99a-69132bc5ee6e service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:19.875632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dd12c-23bb-48ec-b99a-69132bc5ee6e service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:19.875911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dd12c-23bb-48ec-b99a-69132bc5ee6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:19.884607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dd12c-23bb-48ec-b99a-69132bc5ee6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:19.886028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dd12c-23bb-48ec-b99a-69132bc5ee6e service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:19.895304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 660/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:24.812624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0cf6-f5f9-45bb-8e89-5496e630609d None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:24.813216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0cf6-f5f9-45bb-8e89-5496e630609d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:24.813216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0cf6-f5f9-45bb-8e89-5496e630609d None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:24.814531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 681/1341] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:24.820311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd2a36-8b1f-429e-8857-7fa7f48d7485 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:24.820744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd2a36-8b1f-429e-8857-7fa7f48d7485 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:24.821243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd2a36-8b1f-429e-8857-7fa7f48d7485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:24.850993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fbdd2a36-8b1f-429e-8857-7fa7f48d7485 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:24.852180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fbdd2a36-8b1f-429e-8857-7fa7f48d7485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:24.943011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 661/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:24.977365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0cf6-f5f9-45bb-8e89-5496e630609d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:24.988379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0cf6-f5f9-45bb-8e89-5496e630609d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:24.991787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d50c0d-0d70-4c4d-bcd7-2abb387f548d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:24.996366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d50c0d-0d70-4c4d-bcd7-2abb387f548d service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:24.996366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d50c0d-0d70-4c4d-bcd7-2abb387f548d service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:24.996366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d50c0d-0d70-4c4d-bcd7-2abb387f548d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:25.002744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d50c0d-0d70-4c4d-bcd7-2abb387f548d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:25.004212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d50c0d-0d70-4c4d-bcd7-2abb387f548d service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:25.013662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 682/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:28.395359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f289-6f1b-4b29-b85e-44c6fc0490fd None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:28.395897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f289-6f1b-4b29-b85e-44c6fc0490fd None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:28.395897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f289-6f1b-4b29-b85e-44c6fc0490fd None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:28.397230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 662/1344] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:28.402368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdca50-997e-468f-8044-ce99ad004ba7 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:28.402786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdca50-997e-468f-8044-ce99ad004ba7 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:28.402925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdca50-997e-468f-8044-ce99ad004ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:28.420619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-08cdca50-997e-468f-8044-ce99ad004ba7 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:28.422673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-08cdca50-997e-468f-8044-ce99ad004ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:28.430378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 683/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:28.467258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f289-6f1b-4b29-b85e-44c6fc0490fd None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:28.478183 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f289-6f1b-4b29-b85e-44c6fc0490fd None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:28.482296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe65fad-8aac-4322-9c10-ee8f32e4fae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:28.482948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe65fad-8aac-4322-9c10-ee8f32e4fae9 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:28.483806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe65fad-8aac-4322-9c10-ee8f32e4fae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:28.484139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe65fad-8aac-4322-9c10-ee8f32e4fae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:28.493287 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe65fad-8aac-4322-9c10-ee8f32e4fae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:28.494738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe65fad-8aac-4322-9c10-ee8f32e4fae9 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:28.505065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 663/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:33.071227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8a39-60ce-4c4a-a8b2-c5c84e932944 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:33.071734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8a39-60ce-4c4a-a8b2-c5c84e932944 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:33.071845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b8a39-60ce-4c4a-a8b2-c5c84e932944 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:33.073157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 684/1347] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:33.079028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfce72-9f95-4cd2-a29f-a617de36553b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:33.079423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfce72-9f95-4cd2-a29f-a617de36553b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:33.079696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfce72-9f95-4cd2-a29f-a617de36553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:33.097961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4dbfce72-9f95-4cd2-a29f-a617de36553b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:33.099172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4dbfce72-9f95-4cd2-a29f-a617de36553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:33.106939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 664/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:33.144303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b8a39-60ce-4c4a-a8b2-c5c84e932944 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:33.156284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b8a39-60ce-4c4a-a8b2-c5c84e932944 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:33.159871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499acac-06c9-4bde-ba20-3e22f02b14a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:33.160537 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499acac-06c9-4bde-ba20-3e22f02b14a3 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:33.160823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499acac-06c9-4bde-ba20-3e22f02b14a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:33.161098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499acac-06c9-4bde-ba20-3e22f02b14a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:33.170483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499acac-06c9-4bde-ba20-3e22f02b14a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:33.171862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499acac-06c9-4bde-ba20-3e22f02b14a3 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:33.181787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 685/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:38.638309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5a7d6-e7a4-4262-9470-c540b39cd40e None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:38.638834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5a7d6-e7a4-4262-9470-c540b39cd40e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:38.639110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5a7d6-e7a4-4262-9470-c540b39cd40e None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:38.651587 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 665/1350] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 13:52:38 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:38.657062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87de3a-f2c9-4182-8e08-3a0dec96eade None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:38.657549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87de3a-f2c9-4182-8e08-3a0dec96eade None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:38.657633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87de3a-f2c9-4182-8e08-3a0dec96eade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:38.674717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:38.734819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7d87de3a-f2c9-4182-8e08-3a0dec96eade None None] MFA Rules not processed for user `b6375aed65de46e19a9d3da583b42bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:38.736302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7d87de3a-f2c9-4182-8e08-3a0dec96eade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:38.822652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 686/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 13:52:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:43.092030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=57 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:43.241788 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa72bf-cc78-4a84-984f-c6f6c563af9d None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:43.242244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa72bf-cc78-4a84-984f-c6f6c563af9d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:43.242371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa72bf-cc78-4a84-984f-c6f6c563af9d None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:43.244075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 666/1352] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 13:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:43.249370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a72d6d-bf96-4335-937e-e47fd03fe668 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:43.250050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a72d6d-bf96-4335-937e-e47fd03fe668 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:43.250050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a72d6d-bf96-4335-937e-e47fd03fe668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:43.269390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-21a72d6d-bf96-4335-937e-e47fd03fe668 None None] MFA Rules not processed for user `b6375aed65de46e19a9d3da583b42bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:43.270614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-21a72d6d-bf96-4335-937e-e47fd03fe668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:43.280074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 687/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 13:52:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:44.636431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cef72d-e372-4994-9b28-15692b900dba None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:44.637026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cef72d-e372-4994-9b28-15692b900dba None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:44.637189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cef72d-e372-4994-9b28-15692b900dba None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:44.638755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 667/1354] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 13:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:44.644662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7de5b3-11ab-42ab-8037-5d5558e2192a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:44.645129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7de5b3-11ab-42ab-8037-5d5558e2192a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:44.645210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7de5b3-11ab-42ab-8037-5d5558e2192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:44.664742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-bf7de5b3-11ab-42ab-8037-5d5558e2192a None None] MFA Rules not processed for user `b6375aed65de46e19a9d3da583b42bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:44.669944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bf7de5b3-11ab-42ab-8037-5d5558e2192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:44.677039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 688/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 13:52:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:48.599747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869184-eb54-4bef-8b3d-382568d09373 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:48.600295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869184-eb54-4bef-8b3d-382568d09373 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:48.600295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8869184-eb54-4bef-8b3d-382568d09373 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:48.601738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 668/1356] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:48.607093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495133-9c3e-49bd-b840-8c7687c27053 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:48.607506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495133-9c3e-49bd-b840-8c7687c27053 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:48.607679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9495133-9c3e-49bd-b840-8c7687c27053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:48.626180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-e9495133-9c3e-49bd-b840-8c7687c27053 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:48.630320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-e9495133-9c3e-49bd-b840-8c7687c27053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:48.635404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 689/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:48.690098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c55d3-0f5e-4e87-a1b6-1097fcdb2e1f None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:48.690405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c55d3-0f5e-4e87-a1b6-1097fcdb2e1f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:48.690679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c55d3-0f5e-4e87-a1b6-1097fcdb2e1f None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:48.692331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 669/1358] 10.222.0.42 () {54 vars in 961 bytes} [Fri May 27 13:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:48.700125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea888-7627-48b9-8bfb-ce7225d63d85 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:48.700493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea888-7627-48b9-8bfb-ce7225d63d85 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:48.700845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ea888-7627-48b9-8bfb-ce7225d63d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:48.757521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d26ea888-7627-48b9-8bfb-ce7225d63d85 None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:48.758711 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d26ea888-7627-48b9-8bfb-ce7225d63d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:48.823386 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:52:48.846369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 690/1359] 10.222.0.42 () {58 vars in 1058 bytes} [Fri May 27 13:52:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:48.855994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c55d3-0f5e-4e87-a1b6-1097fcdb2e1f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:48.871309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c55d3-0f5e-4e87-a1b6-1097fcdb2e1f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:48.877495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3281eb-1c24-4b07-8d5d-7d459c69540a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:48.878252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3281eb-1c24-4b07-8d5d-7d459c69540a service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:48.878636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3281eb-1c24-4b07-8d5d-7d459c69540a service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:48.879043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3281eb-1c24-4b07-8d5d-7d459c69540a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:48.888157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3281eb-1c24-4b07-8d5d-7d459c69540a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:48.890532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3281eb-1c24-4b07-8d5d-7d459c69540a service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:48.900696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 670/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 13:52:51.357049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bffa7-6053-4095-b972-99218cf43e1c None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:51.357616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bffa7-6053-4095-b972-99218cf43e1c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:51.357616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bffa7-6053-4095-b972-99218cf43e1c None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:51.360151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 691/1361] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:51.364424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b237f-c1be-48e9-a796-f474d7993bbf None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:51.364872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b237f-c1be-48e9-a796-f474d7993bbf None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:51.364972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b237f-c1be-48e9-a796-f474d7993bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:51.383860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a08b237f-c1be-48e9-a796-f474d7993bbf None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:51.385068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a08b237f-c1be-48e9-a796-f474d7993bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:51.393954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 671/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:51.443127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bffa7-6053-4095-b972-99218cf43e1c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:51.460755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bffa7-6053-4095-b972-99218cf43e1c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:51.466444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c62b-2a52-4208-ab9a-52e7bd05cc4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:51.467287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c62b-2a52-4208-ab9a-52e7bd05cc4a service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:51.467681 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c62b-2a52-4208-ab9a-52e7bd05cc4a service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:51.468204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c62b-2a52-4208-ab9a-52e7bd05cc4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:51.477557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c62b-2a52-4208-ab9a-52e7bd05cc4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:51.479611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c62b-2a52-4208-ab9a-52e7bd05cc4a service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:51.490121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 692/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:54.238167 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435546ca-453f-4c29-8575-d848acde8244 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:54.238654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435546ca-453f-4c29-8575-d848acde8244 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:54.238654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435546ca-453f-4c29-8575-d848acde8244 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:54.240070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 672/1364] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:54.245455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6efd2-29c8-426d-84f9-b2352240d364 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:54.245888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6efd2-29c8-426d-84f9-b2352240d364 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:54.246009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6efd2-29c8-426d-84f9-b2352240d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:54.265822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-aed6efd2-29c8-426d-84f9-b2352240d364 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:54.267036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-aed6efd2-29c8-426d-84f9-b2352240d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:54.274802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 693/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:54.321359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86519-2085-4b49-9fac-fe3942a8e847 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:54.321647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86519-2085-4b49-9fac-fe3942a8e847 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:54.321926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86519-2085-4b49-9fac-fe3942a8e847 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:54.323385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 673/1366] 10.222.0.42 () {54 vars in 961 bytes} [Fri May 27 13:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:54.329493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad925adb-43e5-4e3e-be18-1fad7a57eb23 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:54.329782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad925adb-43e5-4e3e-be18-1fad7a57eb23 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:54.330064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad925adb-43e5-4e3e-be18-1fad7a57eb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:54.348585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ad925adb-43e5-4e3e-be18-1fad7a57eb23 None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:54.349772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ad925adb-43e5-4e3e-be18-1fad7a57eb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:54.359353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 694/1367] 10.222.0.42 () {58 vars in 1058 bytes} [Fri May 27 13:52:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:54.367179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e86519-2085-4b49-9fac-fe3942a8e847 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:54.382120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e86519-2085-4b49-9fac-fe3942a8e847 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:54.387653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a51978-b676-4b53-99a3-82a754ffafec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:54.388283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a51978-b676-4b53-99a3-82a754ffafec service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:54.388568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a51978-b676-4b53-99a3-82a754ffafec service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:54.388844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a51978-b676-4b53-99a3-82a754ffafec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:54.397706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a51978-b676-4b53-99a3-82a754ffafec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:54.399316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a51978-b676-4b53-99a3-82a754ffafec service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:54.408858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 674/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:56.957296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d44a-09e6-4848-91a3-d979d84b0ddf None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:56.957871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d44a-09e6-4848-91a3-d979d84b0ddf None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:56.957871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d44a-09e6-4848-91a3-d979d84b0ddf None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:56.959212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 695/1369] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:56.965099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e49e7-84a7-4ed1-b88f-d909dbc55794 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:56.965654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e49e7-84a7-4ed1-b88f-d909dbc55794 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:56.965654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e49e7-84a7-4ed1-b88f-d909dbc55794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:56.978124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353428be-1c98-4c46-8655-6ddd24dc6d5b None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:56.978412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353428be-1c98-4c46-8655-6ddd24dc6d5b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:56.978916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353428be-1c98-4c46-8655-6ddd24dc6d5b None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:56.980352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 696/1370] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:56.985574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4f7e49e7-84a7-4ed1-b88f-d909dbc55794 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:56.986405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b29f29-7e92-4d4f-8161-1de328c52eef None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:56.986699 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b29f29-7e92-4d4f-8161-1de328c52eef None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:56.986805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4f7e49e7-84a7-4ed1-b88f-d909dbc55794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:56.986996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b29f29-7e92-4d4f-8161-1de328c52eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:56.994569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 675/1371] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:57.005184 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a9b29f29-7e92-4d4f-8161-1de328c52eef None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:57.006632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a9b29f29-7e92-4d4f-8161-1de328c52eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:57.019345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 697/1372] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 13:52:57.060630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e49e7-84a7-4ed1-b88f-d909dbc55794 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:57.075097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e49e7-84a7-4ed1-b88f-d909dbc55794 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:57.081664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496197a4-cc18-4da9-a5c8-b155d19bc4f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:57.082323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496197a4-cc18-4da9-a5c8-b155d19bc4f6 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:57.082612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496197a4-cc18-4da9-a5c8-b155d19bc4f6 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:57.082893 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496197a4-cc18-4da9-a5c8-b155d19bc4f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:57.091913 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496197a4-cc18-4da9-a5c8-b155d19bc4f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:57.094383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496197a4-cc18-4da9-a5c8-b155d19bc4f6 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:57.104653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 676/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:52:57.305976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ac3db-02c5-48d9-8782-0f723f1bd8cc None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:57.306266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ac3db-02c5-48d9-8782-0f723f1bd8cc None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:57.306547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ac3db-02c5-48d9-8782-0f723f1bd8cc None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:57.307972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 698/1374] 10.222.0.42 () {54 vars in 963 bytes} [Fri May 27 13:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:52:57.314645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45379b-0529-4504-8405-ffe8f795d9ea None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:57.314936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45379b-0529-4504-8405-ffe8f795d9ea None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:57.315236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45379b-0529-4504-8405-ffe8f795d9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:57.381221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4c45379b-0529-4504-8405-ffe8f795d9ea None None] MFA Rules not processed for user `8e3e451167fc4984be9726430f436e40`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:57.382572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4c45379b-0529-4504-8405-ffe8f795d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:57.464224 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 677/1375] 10.222.0.42 () {58 vars in 1060 bytes} [Fri May 27 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:57.475883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ac3db-02c5-48d9-8782-0f723f1bd8cc None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:57.488384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ac3db-02c5-48d9-8782-0f723f1bd8cc None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:57.492481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf554de5-39a2-4aa0-bb75-adfffdb9852e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:57.493487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf554de5-39a2-4aa0-bb75-adfffdb9852e service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:57.494153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf554de5-39a2-4aa0-bb75-adfffdb9852e service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:57.494637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf554de5-39a2-4aa0-bb75-adfffdb9852e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:57.505862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf554de5-39a2-4aa0-bb75-adfffdb9852e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:57.507973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf554de5-39a2-4aa0-bb75-adfffdb9852e service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:57.519694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 699/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 13:52:59.657510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efe0e9-a2ba-4abf-9e34-055e4dbe76ea None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:59.658091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efe0e9-a2ba-4abf-9e34-055e4dbe76ea None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:59.658091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efe0e9-a2ba-4abf-9e34-055e4dbe76ea None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:59.659520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 678/1377] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:52:59.665476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc83b5-6e27-4dbe-9d4e-6b393413c60a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:59.666010 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc83b5-6e27-4dbe-9d4e-6b393413c60a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:59.666010 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc83b5-6e27-4dbe-9d4e-6b393413c60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:59.686274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-03dc83b5-6e27-4dbe-9d4e-6b393413c60a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:52:59.687589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-03dc83b5-6e27-4dbe-9d4e-6b393413c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:52:59.696027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 700/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:52:59.741166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efe0e9-a2ba-4abf-9e34-055e4dbe76ea None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:52:59.755968 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efe0e9-a2ba-4abf-9e34-055e4dbe76ea None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:52:59.761377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca67253-5e37-4b8c-8777-6058afdb6cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:52:59.762030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca67253-5e37-4b8c-8777-6058afdb6cda service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:52:59.762314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca67253-5e37-4b8c-8777-6058afdb6cda service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:52:59.762589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca67253-5e37-4b8c-8777-6058afdb6cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:52:59.772153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca67253-5e37-4b8c-8777-6058afdb6cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:52:59.773760 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca67253-5e37-4b8c-8777-6058afdb6cda service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:52:59.784660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 679/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:02.217820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ceba0-4375-4e0e-ae04-2e0aa4991eef None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:02.218308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ceba0-4375-4e0e-ae04-2e0aa4991eef None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:02.229613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ceba0-4375-4e0e-ae04-2e0aa4991eef None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:02.229613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 701/1380] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:02.229832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8283-9730-455d-be51-bcc254bb4741 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:02.229832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8283-9730-455d-be51-bcc254bb4741 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:02.229832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8283-9730-455d-be51-bcc254bb4741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:02.245237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fdeb8283-9730-455d-be51-bcc254bb4741 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:02.246532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fdeb8283-9730-455d-be51-bcc254bb4741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:02.256847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 680/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:02.301304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ceba0-4375-4e0e-ae04-2e0aa4991eef None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:02.316757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ceba0-4375-4e0e-ae04-2e0aa4991eef None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:02.322689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67209ac4-3228-4282-9021-ec6b27497c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:02.323398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67209ac4-3228-4282-9021-ec6b27497c3d service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:02.323688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67209ac4-3228-4282-9021-ec6b27497c3d service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:02.323972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67209ac4-3228-4282-9021-ec6b27497c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:02.332620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67209ac4-3228-4282-9021-ec6b27497c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:02.334207 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67209ac4-3228-4282-9021-ec6b27497c3d service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:02.344076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 702/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:05.121997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b53d18-9f88-4363-be62-0feda56f5d28 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:05.122547 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b53d18-9f88-4363-be62-0feda56f5d28 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:05.122547 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b53d18-9f88-4363-be62-0feda56f5d28 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:05.124286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 681/1383] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:05.129878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfc7fc-6811-4f48-b7c3-4419291dea10 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:05.130291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfc7fc-6811-4f48-b7c3-4419291dea10 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:05.130438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecfc7fc-6811-4f48-b7c3-4419291dea10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:05.149920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8ecfc7fc-6811-4f48-b7c3-4419291dea10 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:05.151259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8ecfc7fc-6811-4f48-b7c3-4419291dea10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:05.160176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 703/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:05.201508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b53d18-9f88-4363-be62-0feda56f5d28 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:05.217213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b53d18-9f88-4363-be62-0feda56f5d28 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:05.223640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693c18e-ad25-4250-8c7d-8caa998860e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:05.224362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c18e-ad25-4250-8c7d-8caa998860e8 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:05.224711 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c18e-ad25-4250-8c7d-8caa998860e8 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:05.225161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c18e-ad25-4250-8c7d-8caa998860e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:05.234460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693c18e-ad25-4250-8c7d-8caa998860e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:05.236141 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693c18e-ad25-4250-8c7d-8caa998860e8 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:05.245855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 682/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:07.476223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49811b16-3ea9-402c-9f6e-71dc8d46ce02 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:07.476771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49811b16-3ea9-402c-9f6e-71dc8d46ce02 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:07.477110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49811b16-3ea9-402c-9f6e-71dc8d46ce02 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:07.479065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 704/1386] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:53:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:07.484739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf3c5-b9db-43ec-8d1c-f55d5ec02958 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:07.485162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf3c5-b9db-43ec-8d1c-f55d5ec02958 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:07.485292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf3c5-b9db-43ec-8d1c-f55d5ec02958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:07.503757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-39ccf3c5-b9db-43ec-8d1c-f55d5ec02958 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:07.504950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-39ccf3c5-b9db-43ec-8d1c-f55d5ec02958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:07.513273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 683/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:07.559942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49811b16-3ea9-402c-9f6e-71dc8d46ce02 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:07.579649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49811b16-3ea9-402c-9f6e-71dc8d46ce02 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:07.586744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b89a0-2efe-4114-8981-61d88822fe0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:07.587672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b89a0-2efe-4114-8981-61d88822fe0b service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:07.588048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b89a0-2efe-4114-8981-61d88822fe0b service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:07.588431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b89a0-2efe-4114-8981-61d88822fe0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:07.599112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b89a0-2efe-4114-8981-61d88822fe0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:07.601158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b89a0-2efe-4114-8981-61d88822fe0b service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:07.614370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 705/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:10.042479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888b317-7f4e-4170-b0a5-e804f5a7068e None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:10.043103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888b317-7f4e-4170-b0a5-e804f5a7068e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:10.043217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888b317-7f4e-4170-b0a5-e804f5a7068e None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:10.044539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 684/1389] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:10.050404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23f76-9692-41c8-94ee-ac0d42ecf51a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:10.051009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23f76-9692-41c8-94ee-ac0d42ecf51a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:10.051009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd23f76-9692-41c8-94ee-ac0d42ecf51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:10.070497 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-1bd23f76-9692-41c8-94ee-ac0d42ecf51a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:10.071809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1bd23f76-9692-41c8-94ee-ac0d42ecf51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:10.080571 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 706/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:10.136008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888b317-7f4e-4170-b0a5-e804f5a7068e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:10.150442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888b317-7f4e-4170-b0a5-e804f5a7068e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:10.156376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f487f-de97-4c42-b80b-6c514f820281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:10.157010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f487f-de97-4c42-b80b-6c514f820281 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:10.157291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f487f-de97-4c42-b80b-6c514f820281 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:10.157561 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f487f-de97-4c42-b80b-6c514f820281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:10.165770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f487f-de97-4c42-b80b-6c514f820281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:10.167399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f487f-de97-4c42-b80b-6c514f820281 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:10.177859 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 685/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:12.778905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd94af7-4cc7-473c-9f9e-299cc0d49bca None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:12.779519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd94af7-4cc7-473c-9f9e-299cc0d49bca None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:12.779519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd94af7-4cc7-473c-9f9e-299cc0d49bca None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:12.781278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 707/1392] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:12.786510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9d2c-865c-420e-895c-691f43b48e66 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:12.786999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9d2c-865c-420e-895c-691f43b48e66 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:12.787103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9d2c-865c-420e-895c-691f43b48e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:12.805513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-91fd9d2c-865c-420e-895c-691f43b48e66 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:12.806795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-91fd9d2c-865c-420e-895c-691f43b48e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:12.815517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 686/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:12.859284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd94af7-4cc7-473c-9f9e-299cc0d49bca None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:12.874229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd94af7-4cc7-473c-9f9e-299cc0d49bca None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:12.879676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f5386-ea16-4be1-935a-f60ae8e438f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:12.880312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f5386-ea16-4be1-935a-f60ae8e438f3 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:12.880591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f5386-ea16-4be1-935a-f60ae8e438f3 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:12.880865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f5386-ea16-4be1-935a-f60ae8e438f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:12.888805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f5386-ea16-4be1-935a-f60ae8e438f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:12.890660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1f5386-ea16-4be1-935a-f60ae8e438f3 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:12.899833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 708/1394] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:13.807427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb1b5b-6886-4d3a-95af-606ab4a46601 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:13.807965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb1b5b-6886-4d3a-95af-606ab4a46601 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:13.807965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb1b5b-6886-4d3a-95af-606ab4a46601 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:13.809598 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 687/1395] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:13.815768 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4e6c3-7dac-4cdf-84f6-f5341c6be0f3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:13.816645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4e6c3-7dac-4cdf-84f6-f5341c6be0f3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:13.816961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4e6c3-7dac-4cdf-84f6-f5341c6be0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:13.836109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-cca4e6c3-7dac-4cdf-84f6-f5341c6be0f3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:13.837319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cca4e6c3-7dac-4cdf-84f6-f5341c6be0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:13.845526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 709/1396] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:13.901337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee78d6-c8c5-4fbe-ad0b-c45c439620aa None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:13.901628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee78d6-c8c5-4fbe-ad0b-c45c439620aa None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:13.901911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee78d6-c8c5-4fbe-ad0b-c45c439620aa None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:13.903314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 688/1397] 10.222.0.42 () {54 vars in 962 bytes} [Fri May 27 13:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:13.908901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448fef-238f-4301-8869-7ba561908069 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:13.909188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448fef-238f-4301-8869-7ba561908069 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:13.909467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448fef-238f-4301-8869-7ba561908069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:13.959989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-c5448fef-238f-4301-8869-7ba561908069 None None] MFA Rules not processed for user `bbb36541c7ba418a843e5ecbb1f1e337`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:13.961444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c5448fef-238f-4301-8869-7ba561908069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:14.020280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 710/1398] 10.222.0.42 () {58 vars in 1059 bytes} [Fri May 27 13:53:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:14.027956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee78d6-c8c5-4fbe-ad0b-c45c439620aa None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:14.033729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:53:14.039324 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee78d6-c8c5-4fbe-ad0b-c45c439620aa None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:14.042870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d7c74-fffd-4e5d-951d-ff5ea49b2af4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb36541c7ba418a843e5ecbb1f1e337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:14.046128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d7c74-fffd-4e5d-951d-ff5ea49b2af4 service glance] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:14.046128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d7c74-fffd-4e5d-951d-ff5ea49b2af4 service glance] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:14.046128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d7c74-fffd-4e5d-951d-ff5ea49b2af4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:14.053629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d7c74-fffd-4e5d-951d-ff5ea49b2af4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:14.055155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d7c74-fffd-4e5d-951d-ff5ea49b2af4 service glance] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:14.066341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 689/1399] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 13:53:14.798453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28b981-1440-40ee-b272-b289ba568bd8 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:14.798750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28b981-1440-40ee-b272-b289ba568bd8 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:14.799062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28b981-1440-40ee-b272-b289ba568bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:14.821408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:53:14.848547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0e28b981-1440-40ee-b272-b289ba568bd8 None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:14.849760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0e28b981-1440-40ee-b272-b289ba568bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:14.914658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 711/1400] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 13:53:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:14.955910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bfeab-1420-4f39-8b24-94810856c279 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:14.956437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bfeab-1420-4f39-8b24-94810856c279 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:14.956590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bfeab-1420-4f39-8b24-94810856c279 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:14.958103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 690/1401] 10.222.0.42 () {54 vars in 942 bytes} [Fri May 27 13:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:14.964694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3fb5-8cd5-4c7b-ad72-ee3b85a8dc9c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:14.965060 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3fb5-8cd5-4c7b-ad72-ee3b85a8dc9c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:14.965402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3fb5-8cd5-4c7b-ad72-ee3b85a8dc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:15.014985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-10ff3fb5-8cd5-4c7b-ad72-ee3b85a8dc9c None None] MFA Rules not processed for user `d8ea258578544e5c8f05b751d31e0f34`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:15.016160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-10ff3fb5-8cd5-4c7b-ad72-ee3b85a8dc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:15.090228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 712/1402] 10.222.0.42 () {58 vars in 1039 bytes} [Fri May 27 13:53:14 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:15.100351 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bfeab-1420-4f39-8b24-94810856c279 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:15.113967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bfeab-1420-4f39-8b24-94810856c279 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:15.119016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c488862-eb3e-4263-a912-56b298cf63e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:15.119756 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c488862-eb3e-4263-a912-56b298cf63e6 service swift] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:15.120117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c488862-eb3e-4263-a912-56b298cf63e6 service swift] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:15.120405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c488862-eb3e-4263-a912-56b298cf63e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:15.128747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c488862-eb3e-4263-a912-56b298cf63e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:15.130337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c488862-eb3e-4263-a912-56b298cf63e6 service swift] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:15.138473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 691/1403] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 13:53:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 13:53:15.384456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6571ec-dc19-4705-9381-b9b0f40f0b3f None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:15.384698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6571ec-dc19-4705-9381-b9b0f40f0b3f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:15.384974 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6571ec-dc19-4705-9381-b9b0f40f0b3f None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:15.386355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 713/1404] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:15.392451 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb778c-86c0-4939-8cde-6ffff6658f45 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:15.392748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb778c-86c0-4939-8cde-6ffff6658f45 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:15.393033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb778c-86c0-4939-8cde-6ffff6658f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:15.410778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-dadb778c-86c0-4939-8cde-6ffff6658f45 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:15.415264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-dadb778c-86c0-4939-8cde-6ffff6658f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:15.419815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 692/1405] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:15.464735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6571ec-dc19-4705-9381-b9b0f40f0b3f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:15.479673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6571ec-dc19-4705-9381-b9b0f40f0b3f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:15.485175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd0d30-868c-44b5-861e-a8cc17be3bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:15.485812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd0d30-868c-44b5-861e-a8cc17be3bd0 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:15.486092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd0d30-868c-44b5-861e-a8cc17be3bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:15.486364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd0d30-868c-44b5-861e-a8cc17be3bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:15.494580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd0d30-868c-44b5-861e-a8cc17be3bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:15.496243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd0d30-868c-44b5-861e-a8cc17be3bd0 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:15.506130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 714/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:18.089560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057014a-41a5-4d6c-84d0-592305906c2b None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:18.090128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057014a-41a5-4d6c-84d0-592305906c2b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:18.090128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057014a-41a5-4d6c-84d0-592305906c2b None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:18.095482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 693/1407] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:53:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:18.099218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81d95f-0de3-4f71-9303-7f676d967f4d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:18.099682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81d95f-0de3-4f71-9303-7f676d967f4d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:18.099762 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81d95f-0de3-4f71-9303-7f676d967f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:18.119154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-bf81d95f-0de3-4f71-9303-7f676d967f4d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:18.120359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bf81d95f-0de3-4f71-9303-7f676d967f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:18.129693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 715/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:18.175862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057014a-41a5-4d6c-84d0-592305906c2b None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:18.191488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057014a-41a5-4d6c-84d0-592305906c2b None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:18.197341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823d34d-0fae-4fbc-9914-5ac5cd43f4d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:18.201951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d34d-0fae-4fbc-9914-5ac5cd43f4d9 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:18.201951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d34d-0fae-4fbc-9914-5ac5cd43f4d9 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:18.201951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d34d-0fae-4fbc-9914-5ac5cd43f4d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:18.207945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823d34d-0fae-4fbc-9914-5ac5cd43f4d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:18.209523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823d34d-0fae-4fbc-9914-5ac5cd43f4d9 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:18.220655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 694/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:28.213173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=87 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:53:28.214996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=20 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:53:40.187927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe534a5-7be6-4e10-aa4d-2edfc8044587 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:40.188348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe534a5-7be6-4e10-aa4d-2edfc8044587 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:40.188488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe534a5-7be6-4e10-aa4d-2edfc8044587 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:40.189876 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 716/1410] 10.222.0.42 () {54 vars in 918 bytes} [Fri May 27 13:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:40.195466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de74821-75c7-4eb4-a6b5-5d34e6cbc0f2 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:40.195908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de74821-75c7-4eb4-a6b5-5d34e6cbc0f2 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:40.199195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de74821-75c7-4eb4-a6b5-5d34e6cbc0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:40.214516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-5de74821-75c7-4eb4-a6b5-5d34e6cbc0f2 None None] MFA Rules not processed for user `b6375aed65de46e19a9d3da583b42bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:40.215744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5de74821-75c7-4eb4-a6b5-5d34e6cbc0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:40.224633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 695/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Fri May 27 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:40.239034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc7bdb-dcfa-40e6-acf0-df9a9932ad04 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:40.239323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc7bdb-dcfa-40e6-acf0-df9a9932ad04 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:40.239623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc7bdb-dcfa-40e6-acf0-df9a9932ad04 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:40.240986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 717/1412] 10.222.0.42 () {54 vars in 918 bytes} [Fri May 27 13:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:40.245735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291bcff-c25c-4c50-af2d-c74ee4e9983b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:40.246045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291bcff-c25c-4c50-af2d-c74ee4e9983b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:40.246322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291bcff-c25c-4c50-af2d-c74ee4e9983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:40.265236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3291bcff-c25c-4c50-af2d-c74ee4e9983b None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:40.266424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3291bcff-c25c-4c50-af2d-c74ee4e9983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:40.275469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 696/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Fri May 27 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:42.950616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e95db-e5b7-4d69-93ec-dfe7a04309a5 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:42.951250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e95db-e5b7-4d69-93ec-dfe7a04309a5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:42.951250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e95db-e5b7-4d69-93ec-dfe7a04309a5 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:42.952557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:42.957875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc0158-975b-4915-b48f-d7f32547f9b1 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:42.958281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc0158-975b-4915-b48f-d7f32547f9b1 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:42.958444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc0158-975b-4915-b48f-d7f32547f9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:42.977008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fbdc0158-975b-4915-b48f-d7f32547f9b1 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:42.978202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fbdc0158-975b-4915-b48f-d7f32547f9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:42.987028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:43.028897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e95db-e5b7-4d69-93ec-dfe7a04309a5 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:43.043797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e95db-e5b7-4d69-93ec-dfe7a04309a5 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:43.049993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d2fe4-22b5-41e2-9d59-688369158534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:43.050665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d2fe4-22b5-41e2-9d59-688369158534 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:43.050951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d2fe4-22b5-41e2-9d59-688369158534 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:43.051323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d2fe4-22b5-41e2-9d59-688369158534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:43.059517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d2fe4-22b5-41e2-9d59-688369158534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:43.061128 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d2fe4-22b5-41e2-9d59-688369158534 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:43.070801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 719/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:44.040878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9094-4c30-4ca9-9965-ab63783ea143 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:44.041463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9094-4c30-4ca9-9965-ab63783ea143 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:44.041463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9094-4c30-4ca9-9965-ab63783ea143 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:44.042871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:44.048123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec77df-f457-4bc3-b8bb-bae033f72908 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:44.048564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec77df-f457-4bc3-b8bb-bae033f72908 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:44.048679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec77df-f457-4bc3-b8bb-bae033f72908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:44.066081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-50ec77df-f457-4bc3-b8bb-bae033f72908 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:44.067296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-50ec77df-f457-4bc3-b8bb-bae033f72908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:44.075088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:44.239652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac9094-4c30-4ca9-9965-ab63783ea143 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:44.253656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac9094-4c30-4ca9-9965-ab63783ea143 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:44.259051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2f0f8-2784-4c07-b4be-0e865318ef96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:44.259685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2f0f8-2784-4c07-b4be-0e865318ef96 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:44.259967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2f0f8-2784-4c07-b4be-0e865318ef96 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:44.260240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2f0f8-2784-4c07-b4be-0e865318ef96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:44.269182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2f0f8-2784-4c07-b4be-0e865318ef96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:44.270812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2f0f8-2784-4c07-b4be-0e865318ef96 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:44.281198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 699/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:45.204957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bbecf-76d5-4db3-bad4-bb6d0bb33951 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:45.205540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bbecf-76d5-4db3-bad4-bb6d0bb33951 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:45.205540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8bbecf-76d5-4db3-bad4-bb6d0bb33951 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:45.206918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:45.212091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d651c-bd06-4c45-a32d-d08ccfd94ce5 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:45.212553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d651c-bd06-4c45-a32d-d08ccfd94ce5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:45.212663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d651c-bd06-4c45-a32d-d08ccfd94ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:45.230781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-440d651c-bd06-4c45-a32d-d08ccfd94ce5 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:45.231994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-440d651c-bd06-4c45-a32d-d08ccfd94ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:45.240406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:45.389519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bbecf-76d5-4db3-bad4-bb6d0bb33951 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:45.403526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8bbecf-76d5-4db3-bad4-bb6d0bb33951 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:45.410221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bf065-b401-4dca-9b1e-20447764293a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:45.410879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf065-b401-4dca-9b1e-20447764293a service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:45.411209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf065-b401-4dca-9b1e-20447764293a service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:45.411492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bf065-b401-4dca-9b1e-20447764293a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:45.419587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bf065-b401-4dca-9b1e-20447764293a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:45.421781 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bf065-b401-4dca-9b1e-20447764293a service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:45.430856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 722/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:46.349130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84922403-2707-47fb-90b3-15c42a62474d None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:46.349686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84922403-2707-47fb-90b3-15c42a62474d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:46.349686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84922403-2707-47fb-90b3-15c42a62474d None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:46.351792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:46.355902 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d0d46-42b1-4a70-9652-24793ab4ec73 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:46.356355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d0d46-42b1-4a70-9652-24793ab4ec73 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:46.356451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d0d46-42b1-4a70-9652-24793ab4ec73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:46.374202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-277d0d46-42b1-4a70-9652-24793ab4ec73 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:46.375510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-277d0d46-42b1-4a70-9652-24793ab4ec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:46.383203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 13:53:46.533049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84922403-2707-47fb-90b3-15c42a62474d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:46.547394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84922403-2707-47fb-90b3-15c42a62474d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:46.552732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d3e04-19bf-4908-baa1-10bc6de9ca79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:46.553363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d3e04-19bf-4908-baa1-10bc6de9ca79 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:46.553648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d3e04-19bf-4908-baa1-10bc6de9ca79 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:46.553940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d3e04-19bf-4908-baa1-10bc6de9ca79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:46.562431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d3e04-19bf-4908-baa1-10bc6de9ca79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:46.564046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d3e04-19bf-4908-baa1-10bc6de9ca79 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:46.573722 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 702/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:47.500936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e81a-04ca-40a3-b6f2-c476b4ed893f None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:47.501379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e81a-04ca-40a3-b6f2-c476b4ed893f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:47.501496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214e81a-04ca-40a3-b6f2-c476b4ed893f None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:47.502890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:47.507893 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746431-d2c7-487b-a96a-a5ab3b0197c4 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:47.508295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746431-d2c7-487b-a96a-a5ab3b0197c4 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:47.508455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59746431-d2c7-487b-a96a-a5ab3b0197c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:47.526988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-59746431-d2c7-487b-a96a-a5ab3b0197c4 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:47.528212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-59746431-d2c7-487b-a96a-a5ab3b0197c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:47.535988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:47.684758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214e81a-04ca-40a3-b6f2-c476b4ed893f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:47.699803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214e81a-04ca-40a3-b6f2-c476b4ed893f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:47.706105 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78744f14-1a28-4a83-873e-155aef171a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:47.706730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78744f14-1a28-4a83-873e-155aef171a16 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:47.707042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78744f14-1a28-4a83-873e-155aef171a16 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:47.707318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78744f14-1a28-4a83-873e-155aef171a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:47.715210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78744f14-1a28-4a83-873e-155aef171a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:47.716770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78744f14-1a28-4a83-873e-155aef171a16 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:47.726005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 725/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:48.660245 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833401b-55f8-417a-a46a-b4011e451fdb None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:48.660811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833401b-55f8-417a-a46a-b4011e451fdb None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:48.660811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833401b-55f8-417a-a46a-b4011e451fdb None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:48.662212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:48.667221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312271a-7629-4d2f-8ed4-026a472340e8 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:48.667651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312271a-7629-4d2f-8ed4-026a472340e8 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:48.667929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312271a-7629-4d2f-8ed4-026a472340e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:48.687147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-1312271a-7629-4d2f-8ed4-026a472340e8 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:48.688814 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1312271a-7629-4d2f-8ed4-026a472340e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:48.697692 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:48.848088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833401b-55f8-417a-a46a-b4011e451fdb None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:48.862429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833401b-55f8-417a-a46a-b4011e451fdb None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:48.867816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40c75c-2664-48a0-bee3-b0d4e05c9362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:48.868453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40c75c-2664-48a0-bee3-b0d4e05c9362 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:48.868744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40c75c-2664-48a0-bee3-b0d4e05c9362 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:48.869025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40c75c-2664-48a0-bee3-b0d4e05c9362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:48.877192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40c75c-2664-48a0-bee3-b0d4e05c9362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:48.878778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40c75c-2664-48a0-bee3-b0d4e05c9362 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:48.888622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 705/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:49.809040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb521b-65a1-4016-8d3d-798702343547 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:49.809579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb521b-65a1-4016-8d3d-798702343547 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:49.809579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb521b-65a1-4016-8d3d-798702343547 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:49.811573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:49.816881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0879df7-43e4-45a5-ac4a-d81364286506 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:49.817294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0879df7-43e4-45a5-ac4a-d81364286506 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:49.817442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0879df7-43e4-45a5-ac4a-d81364286506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:49.836429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f0879df7-43e4-45a5-ac4a-d81364286506 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:49.837607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f0879df7-43e4-45a5-ac4a-d81364286506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:49.845621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:49.994420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb521b-65a1-4016-8d3d-798702343547 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:50.009189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb521b-65a1-4016-8d3d-798702343547 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:50.015456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b475b10-2897-4fdc-a3c4-88b10757881c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:50.016085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475b10-2897-4fdc-a3c4-88b10757881c service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:50.016367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475b10-2897-4fdc-a3c4-88b10757881c service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:50.016642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b475b10-2897-4fdc-a3c4-88b10757881c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:50.025922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b475b10-2897-4fdc-a3c4-88b10757881c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:50.027536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b475b10-2897-4fdc-a3c4-88b10757881c service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:50.037030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 728/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:51.145451 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74aff4f-f92c-4655-ab23-e1c0d9aa2c52 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:51.145990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74aff4f-f92c-4655-ab23-e1c0d9aa2c52 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:51.145990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74aff4f-f92c-4655-ab23-e1c0d9aa2c52 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:51.147489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:51.152571 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7b5f4-67a0-49c3-8bf6-8aa24c581f22 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:51.153005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7b5f4-67a0-49c3-8bf6-8aa24c581f22 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:51.153112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7b5f4-67a0-49c3-8bf6-8aa24c581f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:51.171687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3ef7b5f4-67a0-49c3-8bf6-8aa24c581f22 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:51.172878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3ef7b5f4-67a0-49c3-8bf6-8aa24c581f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:51.180581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:51.329079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74aff4f-f92c-4655-ab23-e1c0d9aa2c52 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:51.343202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74aff4f-f92c-4655-ab23-e1c0d9aa2c52 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:51.348458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47487223-c7ea-40cd-b8f1-2b557f68fd99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:51.349092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487223-c7ea-40cd-b8f1-2b557f68fd99 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:51.349381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487223-c7ea-40cd-b8f1-2b557f68fd99 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:51.349652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47487223-c7ea-40cd-b8f1-2b557f68fd99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:51.358067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487223-c7ea-40cd-b8f1-2b557f68fd99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:51.359975 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47487223-c7ea-40cd-b8f1-2b557f68fd99 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:51.369466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 708/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:52.310280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a857e3b-45e5-4c89-a8ab-d267d0d50e24 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:52.310765 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a857e3b-45e5-4c89-a8ab-d267d0d50e24 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:52.310952 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a857e3b-45e5-4c89-a8ab-d267d0d50e24 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:52.312463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:52.317361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f12ea6-9781-4b9e-b995-96ef6dd08303 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:52.317793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f12ea6-9781-4b9e-b995-96ef6dd08303 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:52.317896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f12ea6-9781-4b9e-b995-96ef6dd08303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:52.337777 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-45f12ea6-9781-4b9e-b995-96ef6dd08303 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:52.339002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-45f12ea6-9781-4b9e-b995-96ef6dd08303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:52.347310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:52.495937 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a857e3b-45e5-4c89-a8ab-d267d0d50e24 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:52.510075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a857e3b-45e5-4c89-a8ab-d267d0d50e24 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:52.517163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99865f9-1b8c-4a34-8242-d874b0ef4400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:52.517791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99865f9-1b8c-4a34-8242-d874b0ef4400 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:52.518070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99865f9-1b8c-4a34-8242-d874b0ef4400 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:52.518341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99865f9-1b8c-4a34-8242-d874b0ef4400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:52.526578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99865f9-1b8c-4a34-8242-d874b0ef4400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:52.528193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99865f9-1b8c-4a34-8242-d874b0ef4400 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:52.538156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 731/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:54.610869 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53804ae-638c-4558-bed6-4c3cca2157b2 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:54.611501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53804ae-638c-4558-bed6-4c3cca2157b2 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:54.611501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53804ae-638c-4558-bed6-4c3cca2157b2 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:54.612818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:54.618123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd12836-9a18-44f7-aef7-f098aac290f9 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:54.618518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd12836-9a18-44f7-aef7-f098aac290f9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:54.619217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd12836-9a18-44f7-aef7-f098aac290f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:54.636491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3dd12836-9a18-44f7-aef7-f098aac290f9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:54.637726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3dd12836-9a18-44f7-aef7-f098aac290f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:54.646006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:54.684537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53804ae-638c-4558-bed6-4c3cca2157b2 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:54.695504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53804ae-638c-4558-bed6-4c3cca2157b2 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:54.699001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b35349-1e16-46e4-844c-49ceacfd26a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:54.699630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b35349-1e16-46e4-844c-49ceacfd26a6 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:54.699911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b35349-1e16-46e4-844c-49ceacfd26a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:54.700186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b35349-1e16-46e4-844c-49ceacfd26a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:54.709627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b35349-1e16-46e4-844c-49ceacfd26a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:54.711094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b35349-1e16-46e4-844c-49ceacfd26a6 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:54.721235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 711/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:57.139920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4f1cb-b196-44dd-abc8-fd539819e62a None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:57.140512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4f1cb-b196-44dd-abc8-fd539819e62a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:57.140512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4f1cb-b196-44dd-abc8-fd539819e62a None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:57.141832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:57.147178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02558ab1-5ff6-4845-be7a-65983f244d1f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:57.147620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02558ab1-5ff6-4845-be7a-65983f244d1f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:57.147743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02558ab1-5ff6-4845-be7a-65983f244d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:57.165503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-02558ab1-5ff6-4845-be7a-65983f244d1f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:57.166677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-02558ab1-5ff6-4845-be7a-65983f244d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:57.175151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:57.213097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4f1cb-b196-44dd-abc8-fd539819e62a None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:57.224302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4f1cb-b196-44dd-abc8-fd539819e62a None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:57.227740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e62d6b-6fd8-4e94-a740-750a1e66b146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:57.228367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62d6b-6fd8-4e94-a740-750a1e66b146 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:57.228647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62d6b-6fd8-4e94-a740-750a1e66b146 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:57.228917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62d6b-6fd8-4e94-a740-750a1e66b146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:57.238194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e62d6b-6fd8-4e94-a740-750a1e66b146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:57.239641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e62d6b-6fd8-4e94-a740-750a1e66b146 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:57.248769 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 734/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:53:59.877234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50ab58-ddc2-4b8a-8ef2-9cde8c147258 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:59.877836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50ab58-ddc2-4b8a-8ef2-9cde8c147258 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:59.877836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50ab58-ddc2-4b8a-8ef2-9cde8c147258 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:59.879277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:53:59.884651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb24c8-5aa5-4da5-bfd7-4dad08acac9e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:59.885140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb24c8-5aa5-4da5-bfd7-4dad08acac9e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:59.885243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb24c8-5aa5-4da5-bfd7-4dad08acac9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:59.902671 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f9eb24c8-5aa5-4da5-bfd7-4dad08acac9e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:53:59.903904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f9eb24c8-5aa5-4da5-bfd7-4dad08acac9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:59.911789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:53:59.951154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50ab58-ddc2-4b8a-8ef2-9cde8c147258 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:53:59.953011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1d50ab58-ddc2-4b8a-8ef2-9cde8c147258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:53:59.965811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50ab58-ddc2-4b8a-8ef2-9cde8c147258 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:53:59.969999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f6a3c-1d73-4b31-b40d-7432c8d45c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:53:59.970640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f6a3c-1d73-4b31-b40d-7432c8d45c58 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:53:59.970922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f6a3c-1d73-4b31-b40d-7432c8d45c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:53:59.971231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f6a3c-1d73-4b31-b40d-7432c8d45c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:53:59.980219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f6a3c-1d73-4b31-b40d-7432c8d45c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:53:59.981647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f6a3c-1d73-4b31-b40d-7432c8d45c58 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:53:59.991570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 714/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:02.381709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb9f6-c204-46b0-845b-3824708dbc73 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:02.382278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb9f6-c204-46b0-845b-3824708dbc73 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:02.382278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb9f6-c204-46b0-845b-3824708dbc73 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:02.383696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:02.389757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76315757-d2d4-4bb2-a92d-35c5559adfdc None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:02.390281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76315757-d2d4-4bb2-a92d-35c5559adfdc None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:02.390631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76315757-d2d4-4bb2-a92d-35c5559adfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:02.409246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-76315757-d2d4-4bb2-a92d-35c5559adfdc None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:02.410509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-76315757-d2d4-4bb2-a92d-35c5559adfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:02.418354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:02.457276 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb9f6-c204-46b0-845b-3824708dbc73 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:02.467995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb9f6-c204-46b0-845b-3824708dbc73 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:02.471460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051b738-e582-4db9-a925-b37b6de93995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:02.472085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051b738-e582-4db9-a925-b37b6de93995 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:02.472364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051b738-e582-4db9-a925-b37b6de93995 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:02.472638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051b738-e582-4db9-a925-b37b6de93995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:02.481288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051b738-e582-4db9-a925-b37b6de93995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:02.482770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051b738-e582-4db9-a925-b37b6de93995 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:02.492137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 737/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:04.906419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fddd3c-761b-4c97-a9c9-43b51af9f8b0 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:04.907003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fddd3c-761b-4c97-a9c9-43b51af9f8b0 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:04.907003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fddd3c-761b-4c97-a9c9-43b51af9f8b0 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:04.908460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:04.913958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc74ebd-8b3f-4096-b7ee-54f6c7fc21ab None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:04.914372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc74ebd-8b3f-4096-b7ee-54f6c7fc21ab None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:04.914541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc74ebd-8b3f-4096-b7ee-54f6c7fc21ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:04.932547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ddc74ebd-8b3f-4096-b7ee-54f6c7fc21ab None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:04.933655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ddc74ebd-8b3f-4096-b7ee-54f6c7fc21ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:04.941654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:04.980643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fddd3c-761b-4c97-a9c9-43b51af9f8b0 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:04.992274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fddd3c-761b-4c97-a9c9-43b51af9f8b0 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:04.995801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd615e5e-8d0b-4cc0-9390-86b4ef888388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:04.996432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd615e5e-8d0b-4cc0-9390-86b4ef888388 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:04.996715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd615e5e-8d0b-4cc0-9390-86b4ef888388 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:04.996991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd615e5e-8d0b-4cc0-9390-86b4ef888388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:05.006153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd615e5e-8d0b-4cc0-9390-86b4ef888388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:05.007621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd615e5e-8d0b-4cc0-9390-86b4ef888388 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:05.017483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 717/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:07.282194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eace475-75ec-47ad-8d10-047209c5eb26 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:07.282812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eace475-75ec-47ad-8d10-047209c5eb26 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:07.282812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eace475-75ec-47ad-8d10-047209c5eb26 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:07.284160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:07.289621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea9def-d7dd-4cb8-8515-a9d4634ca0f5 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:07.290080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea9def-d7dd-4cb8-8515-a9d4634ca0f5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:07.290177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea9def-d7dd-4cb8-8515-a9d4634ca0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:07.307854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-b8ea9def-d7dd-4cb8-8515-a9d4634ca0f5 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:07.309044 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b8ea9def-d7dd-4cb8-8515-a9d4634ca0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:07.316973 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 13:54:07.355105 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eace475-75ec-47ad-8d10-047209c5eb26 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:07.365706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eace475-75ec-47ad-8d10-047209c5eb26 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:07.369130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84381bbb-0154-4120-9582-36eb248639ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:07.369755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84381bbb-0154-4120-9582-36eb248639ee service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:07.370035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84381bbb-0154-4120-9582-36eb248639ee service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:07.370308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84381bbb-0154-4120-9582-36eb248639ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:07.379240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84381bbb-0154-4120-9582-36eb248639ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:07.380644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84381bbb-0154-4120-9582-36eb248639ee service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:07.390515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 740/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:09.633806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45908518-9e62-46d2-bfb3-6b63681d6ab1 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:09.634360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45908518-9e62-46d2-bfb3-6b63681d6ab1 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:09.634360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45908518-9e62-46d2-bfb3-6b63681d6ab1 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:09.635792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:09.641793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deecd9-e28c-4b3f-a31b-e92c35bfbb07 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:09.642218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deecd9-e28c-4b3f-a31b-e92c35bfbb07 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:09.642348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82deecd9-e28c-4b3f-a31b-e92c35bfbb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:09.648435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=70 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:54:09.661002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-82deecd9-e28c-4b3f-a31b-e92c35bfbb07 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:09.662182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-82deecd9-e28c-4b3f-a31b-e92c35bfbb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:09.669906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:09.706788 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45908518-9e62-46d2-bfb3-6b63681d6ab1 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:09.712243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=73 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:54:09.718489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45908518-9e62-46d2-bfb3-6b63681d6ab1 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:09.721967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234c690-edd3-43e6-b190-c57a83515520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:09.722633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c690-edd3-43e6-b190-c57a83515520 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:09.724219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c690-edd3-43e6-b190-c57a83515520 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:09.724219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234c690-edd3-43e6-b190-c57a83515520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:09.732098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234c690-edd3-43e6-b190-c57a83515520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:09.733612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234c690-edd3-43e6-b190-c57a83515520 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:09.743308 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 720/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:11.988257 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e902bf-c1c9-431e-a24b-0ec067c8a140 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:11.988807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e902bf-c1c9-431e-a24b-0ec067c8a140 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:11.988807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e902bf-c1c9-431e-a24b-0ec067c8a140 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:11.990788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:54:11.996466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3005fe-c189-4da8-bfa7-2a3a076e0e7a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:11.996937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3005fe-c189-4da8-bfa7-2a3a076e0e7a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:11.997034 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3005fe-c189-4da8-bfa7-2a3a076e0e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:12.016357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-1c3005fe-c189-4da8-bfa7-2a3a076e0e7a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:12.017609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1c3005fe-c189-4da8-bfa7-2a3a076e0e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:12.026408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:12.064563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e902bf-c1c9-431e-a24b-0ec067c8a140 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:12.075339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e902bf-c1c9-431e-a24b-0ec067c8a140 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:12.079469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26b439-af14-45b2-bccc-1e0c7f568b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:12.080099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26b439-af14-45b2-bccc-1e0c7f568b1a service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:12.080381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26b439-af14-45b2-bccc-1e0c7f568b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:12.080656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26b439-af14-45b2-bccc-1e0c7f568b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:12.089800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26b439-af14-45b2-bccc-1e0c7f568b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:12.091262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26b439-af14-45b2-bccc-1e0c7f568b1a service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:12.101213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 743/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:14.304938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02b68-14bf-4a8f-81c0-98c0f28a284f None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:14.305530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02b68-14bf-4a8f-81c0-98c0f28a284f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:14.305530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa02b68-14bf-4a8f-81c0-98c0f28a284f None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:14.306868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:14.313087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318e63d-4fff-4fbe-9170-ea7d8d75694f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:14.313542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318e63d-4fff-4fbe-9170-ea7d8d75694f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:14.313647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318e63d-4fff-4fbe-9170-ea7d8d75694f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:14.331854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-2318e63d-4fff-4fbe-9170-ea7d8d75694f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:14.333945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-2318e63d-4fff-4fbe-9170-ea7d8d75694f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:14.344279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:14.380591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02b68-14bf-4a8f-81c0-98c0f28a284f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:14.391929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa02b68-14bf-4a8f-81c0-98c0f28a284f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:14.395503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1b9b-b316-4611-b8fe-cddb624de61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:14.396139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1b9b-b316-4611-b8fe-cddb624de61f service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:14.396421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1b9b-b316-4611-b8fe-cddb624de61f service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:14.396704 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1b9b-b316-4611-b8fe-cddb624de61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:14.406462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1b9b-b316-4611-b8fe-cddb624de61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:14.407952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1b9b-b316-4611-b8fe-cddb624de61f service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:14.417337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 723/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:16.669334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356850d9-2937-4d36-928a-d7db88164ff4 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:16.669915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356850d9-2937-4d36-928a-d7db88164ff4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:16.669915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356850d9-2937-4d36-928a-d7db88164ff4 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:16.671885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:16.677288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f63c1-a12c-45ea-a612-f8f3f900cdda None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:16.677703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f63c1-a12c-45ea-a612-f8f3f900cdda None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:16.677851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f63c1-a12c-45ea-a612-f8f3f900cdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:16.696576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-172f63c1-a12c-45ea-a612-f8f3f900cdda None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:16.697776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-172f63c1-a12c-45ea-a612-f8f3f900cdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:16.705894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:16.742810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356850d9-2937-4d36-928a-d7db88164ff4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:16.754238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356850d9-2937-4d36-928a-d7db88164ff4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:16.757740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b650656-5e1c-4be0-8638-8414af8d3854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:16.758364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b650656-5e1c-4be0-8638-8414af8d3854 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:16.758641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b650656-5e1c-4be0-8638-8414af8d3854 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:16.758910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b650656-5e1c-4be0-8638-8414af8d3854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:16.767593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b650656-5e1c-4be0-8638-8414af8d3854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:16.769007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b650656-5e1c-4be0-8638-8414af8d3854 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:16.778450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 746/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:26.691233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=17 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:54:26.774092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=17 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:54:50.146801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f45e6-ebca-40f3-ad28-44fb001117a4 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:50.147456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f45e6-ebca-40f3-ad28-44fb001117a4 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:50.147456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f45e6-ebca-40f3-ad28-44fb001117a4 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:50.148776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 725/1471] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:50.154004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0753d-127b-40f6-a074-c460f79da8f0 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:50.155177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0753d-127b-40f6-a074-c460f79da8f0 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:50.155288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0753d-127b-40f6-a074-c460f79da8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:50.172925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-22f0753d-127b-40f6-a074-c460f79da8f0 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:50.174116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-22f0753d-127b-40f6-a074-c460f79da8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:50.181842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 747/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:50.230375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2609e-2b91-4a7f-853d-0432aa31369b None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:50.230663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2609e-2b91-4a7f-853d-0432aa31369b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:50.230942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2609e-2b91-4a7f-853d-0432aa31369b None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:50.232552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 726/1473] 10.222.0.42 () {54 vars in 962 bytes} [Fri May 27 13:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:50.237600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4609-478c-45e6-98b4-d6c03f356aa6 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:50.237896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4609-478c-45e6-98b4-d6c03f356aa6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:50.238178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4609-478c-45e6-98b4-d6c03f356aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:50.256464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-dc1a4609-478c-45e6-98b4-d6c03f356aa6 None None] MFA Rules not processed for user `bbb36541c7ba418a843e5ecbb1f1e337`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:50.257650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-dc1a4609-478c-45e6-98b4-d6c03f356aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:50.264684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 748/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Fri May 27 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:50.271980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2609e-2b91-4a7f-853d-0432aa31369b None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:50.283427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2609e-2b91-4a7f-853d-0432aa31369b None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:50.286960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43af1a-61b5-48dd-8736-2c7a10f0c8f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb36541c7ba418a843e5ecbb1f1e337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:50.291292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43af1a-61b5-48dd-8736-2c7a10f0c8f6 service glance] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:50.291292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43af1a-61b5-48dd-8736-2c7a10f0c8f6 service glance] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:50.291292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43af1a-61b5-48dd-8736-2c7a10f0c8f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:50.297239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43af1a-61b5-48dd-8736-2c7a10f0c8f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:50.298663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43af1a-61b5-48dd-8736-2c7a10f0c8f6 service glance] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:50.308052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 727/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:52.612726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea88d93-4cd0-4bf2-b889-40f1307dd0a2 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:52.613266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea88d93-4cd0-4bf2-b889-40f1307dd0a2 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:52.613266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea88d93-4cd0-4bf2-b889-40f1307dd0a2 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:52.614611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 749/1476] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:52.619991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc52ebd-12ae-4432-8ab6-de56242ed6b9 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:52.620438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc52ebd-12ae-4432-8ab6-de56242ed6b9 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:52.620554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc52ebd-12ae-4432-8ab6-de56242ed6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:52.637919 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-2bc52ebd-12ae-4432-8ab6-de56242ed6b9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:52.639746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2bc52ebd-12ae-4432-8ab6-de56242ed6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:52.647430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 728/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:52.671059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea88d93-4cd0-4bf2-b889-40f1307dd0a2 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:52.683829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea88d93-4cd0-4bf2-b889-40f1307dd0a2 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:52.689046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b183ae9-0858-44b2-bdb4-908a5d943aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:52.689691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b183ae9-0858-44b2-bdb4-908a5d943aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:52.689971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b183ae9-0858-44b2-bdb4-908a5d943aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:52.690247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b183ae9-0858-44b2-bdb4-908a5d943aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:52.691001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b183ae9-0858-44b2-bdb4-908a5d943aa3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:52.692823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WARNING py.warnings [None req-9b183ae9-0858-44b2-bdb4-908a5d943aa3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 13:54:52.692823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: warnings.warn(msg) May 27 13:54:52.692823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: May 27 13:54:52.693965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b183ae9-0858-44b2-bdb4-908a5d943aa3 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:52.713795 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 750/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Fri May 27 13:54:52 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 13:54:54.918741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bb1ce-4b2a-4b46-8d63-ff31f31cc0c5 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:54.919348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bb1ce-4b2a-4b46-8d63-ff31f31cc0c5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:54.919348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bb1ce-4b2a-4b46-8d63-ff31f31cc0c5 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:54.920823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 729/1479] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:54.925908 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b5d0-db14-4f67-a055-116c0715b16d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:54.926342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b5d0-db14-4f67-a055-116c0715b16d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:54.926462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543b5d0-db14-4f67-a055-116c0715b16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:54.944935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-5543b5d0-db14-4f67-a055-116c0715b16d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:54.946393 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5543b5d0-db14-4f67-a055-116c0715b16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:54.954925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 751/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:54.997309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bb1ce-4b2a-4b46-8d63-ff31f31cc0c5 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:55.012782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bb1ce-4b2a-4b46-8d63-ff31f31cc0c5 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:55.019202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76203e82-337d-4721-9a86-d75e3088749f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:55.019854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76203e82-337d-4721-9a86-d75e3088749f service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:55.020136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76203e82-337d-4721-9a86-d75e3088749f service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:55.020412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76203e82-337d-4721-9a86-d75e3088749f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:55.028888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76203e82-337d-4721-9a86-d75e3088749f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:55.030652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76203e82-337d-4721-9a86-d75e3088749f service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:55.040112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 730/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:57.424825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ae7dc-72db-4b5c-a97a-3ff63a6c3975 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:57.425397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ae7dc-72db-4b5c-a97a-3ff63a6c3975 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:57.425397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ae7dc-72db-4b5c-a97a-3ff63a6c3975 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:57.426755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 752/1482] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:57.431937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5887db-0538-4ae4-b207-4ea2863c6c5e None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:57.432360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5887db-0538-4ae4-b207-4ea2863c6c5e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:57.432485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5887db-0538-4ae4-b207-4ea2863c6c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:57.450791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-bf5887db-0538-4ae4-b207-4ea2863c6c5e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:57.452217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-bf5887db-0538-4ae4-b207-4ea2863c6c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:57.459986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 731/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:57.496599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ae7dc-72db-4b5c-a97a-3ff63a6c3975 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:57.507593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ae7dc-72db-4b5c-a97a-3ff63a6c3975 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:57.511048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b8faa-5219-4927-b909-a2378c060488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:57.511701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b8faa-5219-4927-b909-a2378c060488 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:57.511980 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b8faa-5219-4927-b909-a2378c060488 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:57.512253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b8faa-5219-4927-b909-a2378c060488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:57.521498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b8faa-5219-4927-b909-a2378c060488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:57.522903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b8faa-5219-4927-b909-a2378c060488 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:57.532573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 753/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:54:59.830673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b81fe-26dd-44d8-a651-80bde5aa54d6 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:59.831286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b81fe-26dd-44d8-a651-80bde5aa54d6 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:59.831286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b81fe-26dd-44d8-a651-80bde5aa54d6 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:59.832633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 732/1485] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:54:59.838100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b35bdb-6121-45f6-ba65-5843c83b6dbe None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:59.838507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b35bdb-6121-45f6-ba65-5843c83b6dbe None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:59.838657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b35bdb-6121-45f6-ba65-5843c83b6dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:59.856779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-98b35bdb-6121-45f6-ba65-5843c83b6dbe None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:54:59.857969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-98b35bdb-6121-45f6-ba65-5843c83b6dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:54:59.865848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 754/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:54:59.903033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b81fe-26dd-44d8-a651-80bde5aa54d6 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:54:59.914182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b81fe-26dd-44d8-a651-80bde5aa54d6 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:54:59.917636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14745d-13b7-4eb9-ba09-7a0a2f3b5cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:54:59.918265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14745d-13b7-4eb9-ba09-7a0a2f3b5cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:54:59.918542 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14745d-13b7-4eb9-ba09-7a0a2f3b5cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:54:59.918815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14745d-13b7-4eb9-ba09-7a0a2f3b5cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:54:59.927697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14745d-13b7-4eb9-ba09-7a0a2f3b5cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:54:59.929063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14745d-13b7-4eb9-ba09-7a0a2f3b5cd9 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:54:59.938908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 733/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:55:02.305564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcafa6-5e39-4ae1-b30d-eaf9fcf617c4 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:55:02.306198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcafa6-5e39-4ae1-b30d-eaf9fcf617c4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:55:02.306198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcafa6-5e39-4ae1-b30d-eaf9fcf617c4 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:55:02.307593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 755/1488] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:55:02.313107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9c326-a208-41f7-a0b9-c79e24e6895f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:55:02.313583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9c326-a208-41f7-a0b9-c79e24e6895f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:55:02.313694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9c326-a208-41f7-a0b9-c79e24e6895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:55:02.332498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-9fb9c326-a208-41f7-a0b9-c79e24e6895f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:55:02.336680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9fb9c326-a208-41f7-a0b9-c79e24e6895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:55:02.342346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 734/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:55:02.381475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcafa6-5e39-4ae1-b30d-eaf9fcf617c4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:55:02.392748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcafa6-5e39-4ae1-b30d-eaf9fcf617c4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:55:02.396170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189b61e-68a3-4281-a3d4-a9bc17c55a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:55:02.396798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189b61e-68a3-4281-a3d4-a9bc17c55a6e service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:55:02.397080 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189b61e-68a3-4281-a3d4-a9bc17c55a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:55:02.397357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189b61e-68a3-4281-a3d4-a9bc17c55a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:55:02.406993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189b61e-68a3-4281-a3d4-a9bc17c55a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:55:02.408488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189b61e-68a3-4281-a3d4-a9bc17c55a6e service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:55:02.417796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 756/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:55:05.103855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1c8d4-c72c-46f7-8bce-6f48996a0120 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:55:05.104419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1c8d4-c72c-46f7-8bce-6f48996a0120 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:55:05.104419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1c8d4-c72c-46f7-8bce-6f48996a0120 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:55:05.105770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 735/1491] 10.222.0.42 () {54 vars in 926 bytes} [Fri May 27 13:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:55:05.111563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b16f0-bddd-4e7e-859e-2c0b7d7c318d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:55:05.111998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b16f0-bddd-4e7e-859e-2c0b7d7c318d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:55:05.112108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b16f0-bddd-4e7e-859e-2c0b7d7c318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:55:05.131317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-221b16f0-bddd-4e7e-859e-2c0b7d7c318d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:55:05.132528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-221b16f0-bddd-4e7e-859e-2c0b7d7c318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:55:05.140687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 757/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Fri May 27 13:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:55:05.178698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1c8d4-c72c-46f7-8bce-6f48996a0120 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:55:05.190202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1c8d4-c72c-46f7-8bce-6f48996a0120 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:55:05.193714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115235b-830a-49ee-8ee6-428494d39dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:55:05.194358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115235b-830a-49ee-8ee6-428494d39dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:55:05.194644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115235b-830a-49ee-8ee6-428494d39dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:55:05.194925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115235b-830a-49ee-8ee6-428494d39dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:55:05.204435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115235b-830a-49ee-8ee6-428494d39dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:55:05.205861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115235b-830a-49ee-8ee6-428494d39dd2 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:55:05.215358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 736/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:55:15.124965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=33 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:55:15.211126 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=33 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:57:15.637310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1413491-bb2d-475d-8e10-598656e2e9ef None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:15.638439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1413491-bb2d-475d-8e10-598656e2e9ef None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:15.638553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1413491-bb2d-475d-8e10-598656e2e9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:15.657427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f1413491-bb2d-475d-8e10-598656e2e9ef None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:57:15.658640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f1413491-bb2d-475d-8e10-598656e2e9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:57:15.666622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 758/1494] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 13:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:57:15.676188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9c35d-44d5-49fd-a396-f81162314a12 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:15.676677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9c35d-44d5-49fd-a396-f81162314a12 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:15.676777 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9c35d-44d5-49fd-a396-f81162314a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:15.694780 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ebb9c35d-44d5-49fd-a396-f81162314a12 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:57:15.696014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ebb9c35d-44d5-49fd-a396-f81162314a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:57:15.704661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 737/1495] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 13:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:57:15.709222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1413491-bb2d-475d-8e10-598656e2e9ef None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:57:15.719532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1413491-bb2d-475d-8e10-598656e2e9ef None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:57:15.724154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f67247-64c2-4711-8451-ba0159971dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:57:15.724798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f67247-64c2-4711-8451-ba0159971dfe admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:15.725077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f67247-64c2-4711-8451-ba0159971dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:15.725350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f67247-64c2-4711-8451-ba0159971dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:15.726064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f67247-64c2-4711-8451-ba0159971dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 13:57:15.726369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f67247-64c2-4711-8451-ba0159971dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:57:15.727409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WARNING py.warnings [None req-d1f67247-64c2-4711-8451-ba0159971dfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 13:57:15.727409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: warnings.warn(msg) May 27 13:57:15.727409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: May 27 13:57:15.728310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f67247-64c2-4711-8451-ba0159971dfe admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:57:15.739760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 759/1496] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 13:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:57:15.747720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9c35d-44d5-49fd-a396-f81162314a12 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:57:15.756912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9c35d-44d5-49fd-a396-f81162314a12 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:57:15.761671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2e135-5e77-4d45-84ef-4aa3081ebc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:57:15.762319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2e135-5e77-4d45-84ef-4aa3081ebc88 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:15.763147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2e135-5e77-4d45-84ef-4aa3081ebc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:15.763564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2e135-5e77-4d45-84ef-4aa3081ebc88 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:15.764262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2e135-5e77-4d45-84ef-4aa3081ebc88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:57:15.766069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: WARNING py.warnings [None req-d6c2e135-5e77-4d45-84ef-4aa3081ebc88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 13:57:15.766069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: warnings.warn(msg) May 27 13:57:15.766069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: May 27 13:57:15.767300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2e135-5e77-4d45-84ef-4aa3081ebc88 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:57:15.910442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 738/1497] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 13:57:15 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 13:57:15.914762 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f67247-64c2-4711-8451-ba0159971dfe admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:57:15.924995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f67247-64c2-4711-8451-ba0159971dfe admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:57:15.982729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d134f44-ae63-42e6-aecc-f4973deee54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:57:15.983431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d134f44-ae63-42e6-aecc-f4973deee54e admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:15.983714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d134f44-ae63-42e6-aecc-f4973deee54e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:15.983989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d134f44-ae63-42e6-aecc-f4973deee54e admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:15.984680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d134f44-ae63-42e6-aecc-f4973deee54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:57:15.985685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WARNING py.warnings [None req-4d134f44-ae63-42e6-aecc-f4973deee54e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 13:57:15.985685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: warnings.warn(msg) May 27 13:57:15.985685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: May 27 13:57:15.986935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d134f44-ae63-42e6-aecc-f4973deee54e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:57:16.081042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 760/1498] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 13:57:15 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 13:57:16.085144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2e135-5e77-4d45-84ef-4aa3081ebc88 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:57:16.095633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2e135-5e77-4d45-84ef-4aa3081ebc88 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:57:16.100092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11887e-9f2b-4f4c-ad97-f55bb46f9a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:57:16.100748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11887e-9f2b-4f4c-ad97-f55bb46f9a96 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:16.101033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11887e-9f2b-4f4c-ad97-f55bb46f9a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:16.101310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11887e-9f2b-4f4c-ad97-f55bb46f9a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:16.102036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11887e-9f2b-4f4c-ad97-f55bb46f9a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:57:16.103160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: WARNING py.warnings [None req-9c11887e-9f2b-4f4c-ad97-f55bb46f9a96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 13:57:16.103160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: warnings.warn(msg) May 27 13:57:16.103160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: May 27 13:57:16.104049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11887e-9f2b-4f4c-ad97-f55bb46f9a96 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:57:16.116890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 739/1499] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 13:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 13:57:16.120802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d134f44-ae63-42e6-aecc-f4973deee54e admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:57:16.131421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d134f44-ae63-42e6-aecc-f4973deee54e admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:57:16.135942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a48cc-8268-483d-bdc5-f8ee0d45d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:57:16.136598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a48cc-8268-483d-bdc5-f8ee0d45d3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:16.136884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a48cc-8268-483d-bdc5-f8ee0d45d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:16.137162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a48cc-8268-483d-bdc5-f8ee0d45d3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:16.138866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a48cc-8268-483d-bdc5-f8ee0d45d3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:57:16.139956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WARNING py.warnings [None req-bb2a48cc-8268-483d-bdc5-f8ee0d45d3f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 13:57:16.139956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: warnings.warn(msg) May 27 13:57:16.139956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: May 27 13:57:16.140840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a48cc-8268-483d-bdc5-f8ee0d45d3f0 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:57:16.154573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 761/1500] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 13:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 13:57:16.158571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11887e-9f2b-4f4c-ad97-f55bb46f9a96 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:57:16.168432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11887e-9f2b-4f4c-ad97-f55bb46f9a96 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:57:16.173218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abdb29-fa1c-4639-b5c1-37e273a75d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:57:16.174126 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abdb29-fa1c-4639-b5c1-37e273a75d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:16.174406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abdb29-fa1c-4639-b5c1-37e273a75d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:16.174678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abdb29-fa1c-4639-b5c1-37e273a75d99 admin admin] PATH_INFO: `/v3/projects/569804178bf5498fa3688fbd3940c806/users/5be0679a95c4471eb6e281bbff1c2dee/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:16.189798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abdb29-fa1c-4639-b5c1-37e273a75d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569804178bf5498fa3688fbd3940c806, user_id=5be0679a95c4471eb6e281bbff1c2dee, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:57:16.190870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: WARNING py.warnings [None req-52abdb29-fa1c-4639-b5c1-37e273a75d99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 13:57:16.190870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: warnings.warn(msg) May 27 13:57:16.190870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: May 27 13:57:16.192853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abdb29-fa1c-4639-b5c1-37e273a75d99 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:57:16.285412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 740/1501] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 13:57:16 2022] PUT /identity/v3/projects/569804178bf5498fa3688fbd3940c806/users/5be0679a95c4471eb6e281bbff1c2dee/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:57:16.297040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f7634-520a-4841-a7e6-495a010ba802 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:16.297334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f7634-520a-4841-a7e6-495a010ba802 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:16.297613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0f7634-520a-4841-a7e6-495a010ba802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:16.324162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0e0f7634-520a-4841-a7e6-495a010ba802 None None] MFA Rules not processed for user `5be0679a95c4471eb6e281bbff1c2dee`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:57:16.325691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0e0f7634-520a-4841-a7e6-495a010ba802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:57:16.389207 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 762/1502] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 13:57:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:57:16.402235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916eee2-b24b-491e-89aa-a81b5aff5604 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:16.402552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916eee2-b24b-491e-89aa-a81b5aff5604 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:16.402827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916eee2-b24b-491e-89aa-a81b5aff5604 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:16.404382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 741/1503] 10.222.0.42 () {54 vars in 963 bytes} [Fri May 27 13:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:57:16.409294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3e0e-cc92-47f9-b6fc-22d48a79292b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:16.409707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3e0e-cc92-47f9-b6fc-22d48a79292b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:16.409988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3e0e-cc92-47f9-b6fc-22d48a79292b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:16.428354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-776c3e0e-cc92-47f9-b6fc-22d48a79292b None None] MFA Rules not processed for user `8e3e451167fc4984be9726430f436e40`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:57:16.429477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-776c3e0e-cc92-47f9-b6fc-22d48a79292b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:57:16.472626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:57:16.479858 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 763/1504] 10.222.0.42 () {58 vars in 1060 bytes} [Fri May 27 13:57:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:57:16.488945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916eee2-b24b-491e-89aa-a81b5aff5604 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:57:16.500425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916eee2-b24b-491e-89aa-a81b5aff5604 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:57:16.504152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffdcce-478a-4f27-9fc3-89c9bdddbd42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:57:16.504787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffdcce-478a-4f27-9fc3-89c9bdddbd42 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:16.505068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffdcce-478a-4f27-9fc3-89c9bdddbd42 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:16.505341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffdcce-478a-4f27-9fc3-89c9bdddbd42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:16.514023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffdcce-478a-4f27-9fc3-89c9bdddbd42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:57:16.515488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ffdcce-478a-4f27-9fc3-89c9bdddbd42 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:57:16.524272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 742/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:57:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:57:16.566320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363797b6-ebfe-4b1f-8ed6-6fc28da88ce0 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:16.566618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363797b6-ebfe-4b1f-8ed6-6fc28da88ce0 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:16.566899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363797b6-ebfe-4b1f-8ed6-6fc28da88ce0 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:16.568217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 764/1506] 10.222.0.42 () {52 vars in 829 bytes} [Fri May 27 13:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:57:16.571918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffdcce-478a-4f27-9fc3-89c9bdddbd42 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:57:16.635831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffdcce-478a-4f27-9fc3-89c9bdddbd42 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:57:16.640388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:57:16.641275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:16.641562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:16.641838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] PATH_INFO: `/v3/users/5be0679a95c4471eb6e281bbff1c2dee` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:16.643068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be0679a95c4471eb6e281bbff1c2dee)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:57:16.644083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: WARNING py.warnings [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 13:57:16.644083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: warnings.warn(msg) May 27 13:57:16.644083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: May 27 13:57:16.645291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:57:16.861709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be0679a95c4471eb6e281bbff1c2dee'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 13:57:16.862442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be0679a95c4471eb6e281bbff1c2dee'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 13:57:16.863074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be0679a95c4471eb6e281bbff1c2dee'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 13:57:16.876106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be0679a95c4471eb6e281bbff1c2dee'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 13:57:16.894061 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be0679a95c4471eb6e281bbff1c2dee'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 13:57:16.898117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:57:16.987441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 743/1507] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 13:57:16 2022] DELETE /identity/v3/users/5be0679a95c4471eb6e281bbff1c2dee => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:57:16.991858 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655a1ef-38fb-4cd7-bd7b-1198fb284e5e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:16.992333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655a1ef-38fb-4cd7-bd7b-1198fb284e5e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:16.992428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655a1ef-38fb-4cd7-bd7b-1198fb284e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:17.009646 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3655a1ef-38fb-4cd7-bd7b-1198fb284e5e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:57:17.010643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3655a1ef-38fb-4cd7-bd7b-1198fb284e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:57:17.067439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 765/1508] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 13:57:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:57:17.077599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:57:17.079064 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:57:17.135716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b33c1f-2f7f-463e-b554-cadf962244fb admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:57:17.140017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d9f4f-32c1-4c18-a08c-cfaf1786fceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:57:17.140663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9f4f-32c1-4c18-a08c-cfaf1786fceb service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:17.140951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9f4f-32c1-4c18-a08c-cfaf1786fceb service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:17.141233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d9f4f-32c1-4c18-a08c-cfaf1786fceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:17.150168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d9f4f-32c1-4c18-a08c-cfaf1786fceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:57:17.151668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d9f4f-32c1-4c18-a08c-cfaf1786fceb service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:57:17.162031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 744/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:57:17.973013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655a1ef-38fb-4cd7-bd7b-1198fb284e5e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:57:17.974519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3655a1ef-38fb-4cd7-bd7b-1198fb284e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:57:17.986765 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655a1ef-38fb-4cd7-bd7b-1198fb284e5e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:57:17.991728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:57:17.992690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:57:17.993260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:57:17.993260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] PATH_INFO: `/v3/projects/569804178bf5498fa3688fbd3940c806` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:57:17.994488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569804178bf5498fa3688fbd3940c806)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:57:17.995535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WARNING py.warnings [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 13:57:17.995535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: warnings.warn(msg) May 27 13:57:17.995535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: May 27 13:57:17.998574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:57:18.239973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569804178bf5498fa3688fbd3940c806', 'request_id': 'req-0395f749-d7a9-499c-a62d-1e60a823a436'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 13:57:18.246223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569804178bf5498fa3688fbd3940c806', 'request_id': 'req-0395f749-d7a9-499c-a62d-1e60a823a436'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 13:57:18.261535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569804178bf5498fa3688fbd3940c806', 'request_id': 'req-0395f749-d7a9-499c-a62d-1e60a823a436'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 13:57:18.411104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] The token cache is being invalidate because project 569804178bf5498fa3688fbd3940c806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 13:57:18.411396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 13:57:18.412117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0395f749-d7a9-499c-a62d-1e60a823a436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 13:57:18.413693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 766/1510] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 13:57:17 2022] DELETE /identity/v3/projects/569804178bf5498fa3688fbd3940c806 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 13:57:27.157819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:57:28.407878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:59:00.989150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc344c-553a-409a-9c0c-0f095707eb74 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:00.989741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc344c-553a-409a-9c0c-0f095707eb74 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:00.989741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc344c-553a-409a-9c0c-0f095707eb74 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:00.991156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:59:00.995844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1d1d-ee99-4731-8635-e78ae4f793f9 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:00.996301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1d1d-ee99-4731-8635-e78ae4f793f9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:00.996409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1d1d-ee99-4731-8635-e78ae4f793f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:01.015800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-bd8f1d1d-ee99-4731-8635-e78ae4f793f9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:59:01.017002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bd8f1d1d-ee99-4731-8635-e78ae4f793f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:01.090607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:59:01.263591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc344c-553a-409a-9c0c-0f095707eb74 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:59:01.265563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-06bc344c-553a-409a-9c0c-0f095707eb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:01.344393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc344c-553a-409a-9c0c-0f095707eb74 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:59:01.349862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797046f-a275-4c17-abcf-a31222aa9a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:59:01.350508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797046f-a275-4c17-abcf-a31222aa9a93 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:01.350793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797046f-a275-4c17-abcf-a31222aa9a93 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:01.351098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797046f-a275-4c17-abcf-a31222aa9a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:01.359993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797046f-a275-4c17-abcf-a31222aa9a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:59:01.361594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797046f-a275-4c17-abcf-a31222aa9a93 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:59:01.370929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 746/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:59:02.248117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca8bd3-2889-43e9-8041-d32bf3b6732a None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:02.248635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca8bd3-2889-43e9-8041-d32bf3b6732a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:02.248746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca8bd3-2889-43e9-8041-d32bf3b6732a None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:02.250056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 13:59:02.255181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6af4d-ea1c-4602-baed-ab14f357d9eb None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:02.255642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6af4d-ea1c-4602-baed-ab14f357d9eb None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:02.255756 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6af4d-ea1c-4602-baed-ab14f357d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:02.274853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-49f6af4d-ea1c-4602-baed-ab14f357d9eb None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:59:02.278751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-49f6af4d-ea1c-4602-baed-ab14f357d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:02.285070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:59:02.405498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c3a9-de01-4eab-9a27-04083909d383 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:02.405844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c3a9-de01-4eab-9a27-04083909d383 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:02.406118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c3a9-de01-4eab-9a27-04083909d383 None None] PATH_INFO: `/v3` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:02.407491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 769/1516] 10.222.0.64 () {54 vars in 925 bytes} [Fri May 27 13:59:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 13:59:02.413623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7d164-deef-4b02-89a1-87d46cb41337 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:02.413916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7d164-deef-4b02-89a1-87d46cb41337 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:02.414219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7d164-deef-4b02-89a1-87d46cb41337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:02.434052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-1be7d164-deef-4b02-89a1-87d46cb41337 None None] MFA Rules not processed for user `b6375aed65de46e19a9d3da583b42bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:59:02.435400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1be7d164-deef-4b02-89a1-87d46cb41337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:02.448146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990c3a9-de01-4eab-9a27-04083909d383 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:59:02.463541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990c3a9-de01-4eab-9a27-04083909d383 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:59:02.469231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4490f-d541-4f9f-969b-07da6f627753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:59:02.469813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4490f-d541-4f9f-969b-07da6f627753 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:02.470099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4490f-d541-4f9f-969b-07da6f627753 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:02.470375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4490f-d541-4f9f-969b-07da6f627753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:02.479546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4490f-d541-4f9f-969b-07da6f627753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:59:02.481223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4490f-d541-4f9f-969b-07da6f627753 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:59:02.491457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 770/1517] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 13:59:02.500460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 748/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Fri May 27 13:59:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:59:11.981512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39377b9-d777-4c0c-b62e-52ea9173d9ba None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:11.982120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39377b9-d777-4c0c-b62e-52ea9173d9ba None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:11.982120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39377b9-d777-4c0c-b62e-52ea9173d9ba None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:11.983469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 771/1519] 10.222.0.42 () {54 vars in 960 bytes} [Fri May 27 13:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:59:11.988557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e9c18-0669-4004-a687-8d89e3aec3a3 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:11.989016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e9c18-0669-4004-a687-8d89e3aec3a3 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:11.989125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e9c18-0669-4004-a687-8d89e3aec3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:12.007431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-743e9c18-0669-4004-a687-8d89e3aec3a3 None None] MFA Rules not processed for user `b6375aed65de46e19a9d3da583b42bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:59:12.008616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-743e9c18-0669-4004-a687-8d89e3aec3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:12.016969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 749/1520] 10.222.0.42 () {58 vars in 1057 bytes} [Fri May 27 13:59:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:59:12.024485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39377b9-d777-4c0c-b62e-52ea9173d9ba None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:59:12.038036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39377b9-d777-4c0c-b62e-52ea9173d9ba None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:59:12.043463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01491f24-ca05-4e4a-aaad-a6792fc87b9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:59:12.044165 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491f24-ca05-4e4a-aaad-a6792fc87b9e service placement] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:12.044445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491f24-ca05-4e4a-aaad-a6792fc87b9e service placement] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:12.044719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491f24-ca05-4e4a-aaad-a6792fc87b9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:12.052844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01491f24-ca05-4e4a-aaad-a6792fc87b9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:59:12.054410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01491f24-ca05-4e4a-aaad-a6792fc87b9e service placement] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:59:12.064463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 772/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:59:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:59:13.787754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d48f-39f4-4717-a8b7-820add0c86f8 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:13.788332 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d48f-39f4-4717-a8b7-820add0c86f8 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:13.788332 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6d48f-39f4-4717-a8b7-820add0c86f8 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:13.789924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 750/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:59:13.795599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a78a-9001-412a-9865-07e942d2d661 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:13.796104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a78a-9001-412a-9865-07e942d2d661 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:13.796193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878a78a-9001-412a-9865-07e942d2d661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:13.814690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0878a78a-9001-412a-9865-07e942d2d661 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:59:13.815978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0878a78a-9001-412a-9865-07e942d2d661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:13.824312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 773/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:59:13.976834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6d48f-39f4-4717-a8b7-820add0c86f8 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:59:13.991607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6d48f-39f4-4717-a8b7-820add0c86f8 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:59:13.997230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f3d34-e314-4800-80a9-a4b65fc848eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:59:13.997868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f3d34-e314-4800-80a9-a4b65fc848eb service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:13.998177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f3d34-e314-4800-80a9-a4b65fc848eb service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:13.998457 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f3d34-e314-4800-80a9-a4b65fc848eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:14.006602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f3d34-e314-4800-80a9-a4b65fc848eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:59:14.008273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f3d34-e314-4800-80a9-a4b65fc848eb service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:59:14.018497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 751/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:59:14.885458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf4a62-f725-4c6c-82ea-92c903b68909 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:14.885997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf4a62-f725-4c6c-82ea-92c903b68909 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:14.885997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf4a62-f725-4c6c-82ea-92c903b68909 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:14.887460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 774/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 13:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:59:14.892355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb8867-66bf-4c7f-8096-f178f76ea45d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:14.892798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb8867-66bf-4c7f-8096-f178f76ea45d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:14.892892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb8867-66bf-4c7f-8096-f178f76ea45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:14.912570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-7ccb8867-66bf-4c7f-8096-f178f76ea45d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:59:14.913748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7ccb8867-66bf-4c7f-8096-f178f76ea45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:14.922092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 752/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 13:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:59:15.072215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf4a62-f725-4c6c-82ea-92c903b68909 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:59:15.086583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf4a62-f725-4c6c-82ea-92c903b68909 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:59:15.091904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371c90f-5b73-47fa-ba35-8b18fb9f6c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:59:15.092529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371c90f-5b73-47fa-ba35-8b18fb9f6c5d service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:15.092808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371c90f-5b73-47fa-ba35-8b18fb9f6c5d service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:15.093081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371c90f-5b73-47fa-ba35-8b18fb9f6c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:15.100923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371c90f-5b73-47fa-ba35-8b18fb9f6c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:59:15.102500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371c90f-5b73-47fa-ba35-8b18fb9f6c5d service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:59:15.112223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 775/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:59:19.168331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6ab55-9a6d-4058-8551-4ce7331f7b96 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:19.168891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6ab55-9a6d-4058-8551-4ce7331f7b96 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:19.168891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6ab55-9a6d-4058-8551-4ce7331f7b96 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:19.170305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 753/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:59:19.175548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f68566-4886-40bc-b9cd-0f71fa454b1d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:19.175996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f68566-4886-40bc-b9cd-0f71fa454b1d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:19.176094 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f68566-4886-40bc-b9cd-0f71fa454b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:19.194641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-74f68566-4886-40bc-b9cd-0f71fa454b1d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:59:19.196165 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-74f68566-4886-40bc-b9cd-0f71fa454b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:19.205445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 776/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:59:19.242922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6ab55-9a6d-4058-8551-4ce7331f7b96 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:59:19.244666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-bde6ab55-9a6d-4058-8551-4ce7331f7b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:19.300124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:59:19.304205 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6ab55-9a6d-4058-8551-4ce7331f7b96 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:59:19.307860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b123088-88ec-46c2-9fba-f08bfa41055a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:59:19.309114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b123088-88ec-46c2-9fba-f08bfa41055a service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:19.309395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b123088-88ec-46c2-9fba-f08bfa41055a service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:19.309666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b123088-88ec-46c2-9fba-f08bfa41055a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:19.318655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b123088-88ec-46c2-9fba-f08bfa41055a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:59:19.320119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b123088-88ec-46c2-9fba-f08bfa41055a service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:59:19.329814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 754/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:59:21.532736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f550d-3f83-4ff2-8013-5a99d2c05b04 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:21.533306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f550d-3f83-4ff2-8013-5a99d2c05b04 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:21.533306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f550d-3f83-4ff2-8013-5a99d2c05b04 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:21.534698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 777/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:59:21.539845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce17742-22b9-42ae-9bee-892400095dae None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:21.540324 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce17742-22b9-42ae-9bee-892400095dae None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:21.540435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce17742-22b9-42ae-9bee-892400095dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:21.558298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4ce17742-22b9-42ae-9bee-892400095dae None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:59:21.559668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4ce17742-22b9-42ae-9bee-892400095dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:21.567360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 755/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:59:21.603506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f550d-3f83-4ff2-8013-5a99d2c05b04 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:59:21.614367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f550d-3f83-4ff2-8013-5a99d2c05b04 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:59:21.617849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e13ed2-1971-45f2-adde-7a4bf186aaaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:59:21.618472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e13ed2-1971-45f2-adde-7a4bf186aaaf service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:21.618750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e13ed2-1971-45f2-adde-7a4bf186aaaf service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:21.619054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e13ed2-1971-45f2-adde-7a4bf186aaaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:21.628231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e13ed2-1971-45f2-adde-7a4bf186aaaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:59:21.629667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e13ed2-1971-45f2-adde-7a4bf186aaaf service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:59:21.639620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 778/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:59:25.416291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552b5dd-c72a-4a3f-ad4a-ea65ea441bbb None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:25.416825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552b5dd-c72a-4a3f-ad4a-ea65ea441bbb None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:25.416825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552b5dd-c72a-4a3f-ad4a-ea65ea441bbb None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:25.418710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 756/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:59:25.424257 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168865e4-bea9-43ad-a8e0-d1eb158a8dfc None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:25.424697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168865e4-bea9-43ad-a8e0-d1eb158a8dfc None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:25.424805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168865e4-bea9-43ad-a8e0-d1eb158a8dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:25.443519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-168865e4-bea9-43ad-a8e0-d1eb158a8dfc None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:59:25.444706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-168865e4-bea9-43ad-a8e0-d1eb158a8dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:25.452940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 779/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:59:25.724593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552b5dd-c72a-4a3f-ad4a-ea65ea441bbb None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:59:25.726246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e552b5dd-c72a-4a3f-ad4a-ea65ea441bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:25.783085 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552b5dd-c72a-4a3f-ad4a-ea65ea441bbb None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:59:25.786606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fce6b-5523-40ba-97d4-79ea1ba4b5fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:59:25.787269 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fce6b-5523-40ba-97d4-79ea1ba4b5fc service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:25.787551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fce6b-5523-40ba-97d4-79ea1ba4b5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:25.787825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fce6b-5523-40ba-97d4-79ea1ba4b5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:25.797276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fce6b-5523-40ba-97d4-79ea1ba4b5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:59:25.798727 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fce6b-5523-40ba-97d4-79ea1ba4b5fc service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:59:25.808259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 757/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:59:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:59:28.077164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3105ffb-06ff-4a80-a3a1-4098ab178931 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:28.078001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3105ffb-06ff-4a80-a3a1-4098ab178931 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:28.078001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3105ffb-06ff-4a80-a3a1-4098ab178931 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:28.079427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 780/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 13:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 13:59:28.084713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d5763-3d52-426d-a9f2-1acdd7dbebdd None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:28.085155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d5763-3d52-426d-a9f2-1acdd7dbebdd None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:28.085261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d5763-3d52-426d-a9f2-1acdd7dbebdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:28.103276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-c96d5763-3d52-426d-a9f2-1acdd7dbebdd None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 13:59:28.104692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c96d5763-3d52-426d-a9f2-1acdd7dbebdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:28.112449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 758/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 13:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 13:59:28.387176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3105ffb-06ff-4a80-a3a1-4098ab178931 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 13:59:28.388850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c3105ffb-06ff-4a80-a3a1-4098ab178931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 13:59:28.401610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3105ffb-06ff-4a80-a3a1-4098ab178931 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 13:59:28.405193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb07ad-93f2-4ec2-8e92-48715d4bb324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 13:59:28.405819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb07ad-93f2-4ec2-8e92-48715d4bb324 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 13:59:28.406102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb07ad-93f2-4ec2-8e92-48715d4bb324 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 13:59:28.406374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb07ad-93f2-4ec2-8e92-48715d4bb324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 13:59:28.415521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb07ad-93f2-4ec2-8e92-48715d4bb324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 13:59:28.416981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb07ad-93f2-4ec2-8e92-48715d4bb324 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 13:59:28.427084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 781/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 13:59:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 13:59:38.098060 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=36 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 13:59:38.422939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=66 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:00:59.745213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e9c3e-e138-453f-9742-8d9c3055ffc3 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:00:59.746209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e9c3e-e138-453f-9742-8d9c3055ffc3 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:00:59.746662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e9c3e-e138-453f-9742-8d9c3055ffc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:00:59.780283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-7e7e9c3e-e138-453f-9742-8d9c3055ffc3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:00:59.781725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7e7e9c3e-e138-453f-9742-8d9c3055ffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:00:59.789933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 759/1540] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:00:59.799976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da15d-66d3-406e-9db1-f58208d4ed58 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:00:59.800555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da15d-66d3-406e-9db1-f58208d4ed58 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:00:59.800555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73da15d-66d3-406e-9db1-f58208d4ed58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:00:59.824636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b73da15d-66d3-406e-9db1-f58208d4ed58 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:00:59.825854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b73da15d-66d3-406e-9db1-f58208d4ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:00:59.834717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 782/1541] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:00:59.840351 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e9c3e-e138-453f-9742-8d9c3055ffc3 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:00:59.850945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e9c3e-e138-453f-9742-8d9c3055ffc3 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:00:59.860289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d39d5-052c-454c-b081-36fdd20c1145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:00:59.861000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d39d5-052c-454c-b081-36fdd20c1145 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:00:59.861291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d39d5-052c-454c-b081-36fdd20c1145 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:00:59.861575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d39d5-052c-454c-b081-36fdd20c1145 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:00:59.862339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d39d5-052c-454c-b081-36fdd20c1145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:00:59.862652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d39d5-052c-454c-b081-36fdd20c1145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:00:59.863741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: WARNING py.warnings [None req-090d39d5-052c-454c-b081-36fdd20c1145 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 14:00:59.863741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: warnings.warn(msg) May 27 14:00:59.863741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: May 27 14:00:59.864656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d39d5-052c-454c-b081-36fdd20c1145 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:00:59.890747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 760/1542] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:00:59.899157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73da15d-66d3-406e-9db1-f58208d4ed58 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:00:59.911354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73da15d-66d3-406e-9db1-f58208d4ed58 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:00:59.921324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddaec9-2c1e-42aa-9fab-b45e46d906bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:00:59.922013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddaec9-2c1e-42aa-9fab-b45e46d906bd admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:00:59.922557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddaec9-2c1e-42aa-9fab-b45e46d906bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:00:59.922898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddaec9-2c1e-42aa-9fab-b45e46d906bd admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:00:59.923589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddaec9-2c1e-42aa-9fab-b45e46d906bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:00:59.924614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WARNING py.warnings [None req-80ddaec9-2c1e-42aa-9fab-b45e46d906bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 14:00:59.924614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: warnings.warn(msg) May 27 14:00:59.924614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: May 27 14:00:59.925827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddaec9-2c1e-42aa-9fab-b45e46d906bd admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:00:59.967590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc3180-0078-4712-9bc1-4b1075f5f4a4 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:00:59.967941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc3180-0078-4712-9bc1-4b1075f5f4a4 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:00:59.968149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc3180-0078-4712-9bc1-4b1075f5f4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:00:59.991768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-08cc3180-0078-4712-9bc1-4b1075f5f4a4 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:00:59.992981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-08cc3180-0078-4712-9bc1-4b1075f5f4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.001859 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 761/1543] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:00:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.013562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b9026-9845-4546-bb11-51b945f29ed1 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.014106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b9026-9845-4546-bb11-51b945f29ed1 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.014396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b9026-9845-4546-bb11-51b945f29ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.045796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 783/1544] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:00:59 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:00.048022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-553b9026-9845-4546-bb11-51b945f29ed1 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.049325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-553b9026-9845-4546-bb11-51b945f29ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.053821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddaec9-2c1e-42aa-9fab-b45e46d906bd admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.149517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 762/1545] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:00.164089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b9026-9845-4546-bb11-51b945f29ed1 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.168205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddaec9-2c1e-42aa-9fab-b45e46d906bd admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.181096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b9026-9845-4546-bb11-51b945f29ed1 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.184462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497d25a-8ca2-474a-88fd-f785e511ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.185160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497d25a-8ca2-474a-88fd-f785e511ddad admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.185445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497d25a-8ca2-474a-88fd-f785e511ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.185724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497d25a-8ca2-474a-88fd-f785e511ddad admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.186423 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497d25a-8ca2-474a-88fd-f785e511ddad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.187748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca127ca-5ee6-46fc-8a98-f5b254c88d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.188600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca127ca-5ee6-46fc-8a98-f5b254c88d51 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.189058 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca127ca-5ee6-46fc-8a98-f5b254c88d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.189646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca127ca-5ee6-46fc-8a98-f5b254c88d51 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.190725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca127ca-5ee6-46fc-8a98-f5b254c88d51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:00.191197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497d25a-8ca2-474a-88fd-f785e511ddad admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.191408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca127ca-5ee6-46fc-8a98-f5b254c88d51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.193427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca127ca-5ee6-46fc-8a98-f5b254c88d51 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.217117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 763/1546] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:00.225693 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca127ca-5ee6-46fc-8a98-f5b254c88d51 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.257322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca127ca-5ee6-46fc-8a98-f5b254c88d51 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.263492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1f0b0-fc0c-43ee-b856-62487fe76e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.264514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1f0b0-fc0c-43ee-b856-62487fe76e53 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.264963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1f0b0-fc0c-43ee-b856-62487fe76e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.265670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1f0b0-fc0c-43ee-b856-62487fe76e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.266548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1f0b0-fc0c-43ee-b856-62487fe76e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.268732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1f0b0-fc0c-43ee-b856-62487fe76e53 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.299551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 784/1547] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:00.301253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651629c-ed0a-4b45-9501-2f5b10c6ac0d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.301718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651629c-ed0a-4b45-9501-2f5b10c6ac0d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.302160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651629c-ed0a-4b45-9501-2f5b10c6ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.335068 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d651629c-ed0a-4b45-9501-2f5b10c6ac0d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.336833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d651629c-ed0a-4b45-9501-2f5b10c6ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.359006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 785/1548] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.360213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651629c-ed0a-4b45-9501-2f5b10c6ac0d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.370450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651629c-ed0a-4b45-9501-2f5b10c6ac0d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.449978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64353ce-e217-4945-b9f1-74f6500a8e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.449978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64353ce-e217-4945-b9f1-74f6500a8e78 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.449978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64353ce-e217-4945-b9f1-74f6500a8e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.449978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64353ce-e217-4945-b9f1-74f6500a8e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.450474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64353ce-e217-4945-b9f1-74f6500a8e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.450474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64353ce-e217-4945-b9f1-74f6500a8e78 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.450474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 786/1549] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:00.450474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814b5a5-b2b9-4ed8-84b6-d2fc209d69a2 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.450474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814b5a5-b2b9-4ed8-84b6-d2fc209d69a2 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.450474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814b5a5-b2b9-4ed8-84b6-d2fc209d69a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.451007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-1814b5a5-b2b9-4ed8-84b6-d2fc209d69a2 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.451007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1814b5a5-b2b9-4ed8-84b6-d2fc209d69a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.451007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 787/1550] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.451007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faafa9-a722-48d9-b833-ed34b75fb992 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.451007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faafa9-a722-48d9-b833-ed34b75fb992 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.451007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5faafa9-a722-48d9-b833-ed34b75fb992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.451600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b5faafa9-a722-48d9-b833-ed34b75fb992 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.451600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b5faafa9-a722-48d9-b833-ed34b75fb992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.458025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 788/1551] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.459299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd6b0-5a0e-440c-85d7-f54037eda488 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.459592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd6b0-5a0e-440c-85d7-f54037eda488 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.459872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decd6b0-5a0e-440c-85d7-f54037eda488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.478032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8decd6b0-5a0e-440c-85d7-f54037eda488 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.479943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8decd6b0-5a0e-440c-85d7-f54037eda488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.487860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 789/1552] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.494450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdfb55-6246-46ba-ab1e-671f512a825c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.494450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdfb55-6246-46ba-ab1e-671f512a825c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.494450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdfb55-6246-46ba-ab1e-671f512a825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.507879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-70cdfb55-6246-46ba-ab1e-671f512a825c None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.509070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-70cdfb55-6246-46ba-ab1e-671f512a825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.517753 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 790/1553] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.518518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdfb55-6246-46ba-ab1e-671f512a825c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.528391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdfb55-6246-46ba-ab1e-671f512a825c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.533049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df334ed9-d1b6-443c-a14e-ca120105c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.536991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334ed9-d1b6-443c-a14e-ca120105c362 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.536991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334ed9-d1b6-443c-a14e-ca120105c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.536991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df334ed9-d1b6-443c-a14e-ca120105c362 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.536991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df334ed9-d1b6-443c-a14e-ca120105c362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.537363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 764/1554] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/projects => generated 377 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:00.537455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df334ed9-d1b6-443c-a14e-ca120105c362 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.537532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a1141-f078-41c6-b64f-089f6486c6ac None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.537532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a1141-f078-41c6-b64f-089f6486c6ac None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.537688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a1141-f078-41c6-b64f-089f6486c6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.551945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 791/1555] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:00.551945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b6241-c196-4bd1-9534-16bd0ec0f374 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.551945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b6241-c196-4bd1-9534-16bd0ec0f374 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.551945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b6241-c196-4bd1-9534-16bd0ec0f374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.556309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-373a1141-f078-41c6-b64f-089f6486c6ac None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.557519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-373a1141-f078-41c6-b64f-089f6486c6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.568534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-960b6241-c196-4bd1-9534-16bd0ec0f374 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.569714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-960b6241-c196-4bd1-9534-16bd0ec0f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.620415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 765/1556] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.621928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6c47a-5704-4678-8bd8-04593f20511d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.622224 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6c47a-5704-4678-8bd8-04593f20511d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.622499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6c47a-5704-4678-8bd8-04593f20511d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.629785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 792/1557] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.631120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732b54-6a3d-4894-8725-b8af7344b9d5 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.631409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732b54-6a3d-4894-8725-b8af7344b9d5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.631683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732b54-6a3d-4894-8725-b8af7344b9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.645809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-edb6c47a-5704-4678-8bd8-04593f20511d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.647106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-edb6c47a-5704-4678-8bd8-04593f20511d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.655626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:00.659875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 766/1558] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.659875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377465aa-ee2e-45bd-9482-601516e68c55 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.659875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377465aa-ee2e-45bd-9482-601516e68c55 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.659875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377465aa-ee2e-45bd-9482-601516e68c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.660392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-72732b54-6a3d-4894-8725-b8af7344b9d5 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.661235 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-72732b54-6a3d-4894-8725-b8af7344b9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.670550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 793/1559] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.672259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ae1eb-d5b7-4806-8f32-6eec6176fe4d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.672573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ae1eb-d5b7-4806-8f32-6eec6176fe4d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.672852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ae1eb-d5b7-4806-8f32-6eec6176fe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.679047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-377465aa-ee2e-45bd-9482-601516e68c55 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.680284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-377465aa-ee2e-45bd-9482-601516e68c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.688902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 767/1560] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.689926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377465aa-ee2e-45bd-9482-601516e68c55 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.691420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-569ae1eb-d5b7-4806-8f32-6eec6176fe4d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.692626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-569ae1eb-d5b7-4806-8f32-6eec6176fe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.700512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377465aa-ee2e-45bd-9482-601516e68c55 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.705818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 794/1561] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.705818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ae1eb-d5b7-4806-8f32-6eec6176fe4d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.709819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741602-c35d-4d0e-b032-23237ca7422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.710523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741602-c35d-4d0e-b032-23237ca7422b admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.710802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741602-c35d-4d0e-b032-23237ca7422b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.711103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741602-c35d-4d0e-b032-23237ca7422b admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.711788 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741602-c35d-4d0e-b032-23237ca7422b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.712845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: WARNING py.warnings [None req-11741602-c35d-4d0e-b032-23237ca7422b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 14:01:00.712845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: warnings.warn(msg) May 27 14:01:00.712845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: May 27 14:01:00.714717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ae1eb-d5b7-4806-8f32-6eec6176fe4d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.714831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741602-c35d-4d0e-b032-23237ca7422b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.719470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816baa71-e202-445e-b6c6-f6973bd31ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.720417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816baa71-e202-445e-b6c6-f6973bd31ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.720717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816baa71-e202-445e-b6c6-f6973bd31ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.720991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816baa71-e202-445e-b6c6-f6973bd31ab2 admin admin] PATH_INFO: `/v3/projects/5823c2eec14543e5a2d640fba1fa2276/users/4bb3ef10b30d4609a6ffe3ce28ea8f6c/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.735689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816baa71-e202-445e-b6c6-f6973bd31ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5823c2eec14543e5a2d640fba1fa2276, user_id=4bb3ef10b30d4609a6ffe3ce28ea8f6c, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.736715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WARNING py.warnings [None req-816baa71-e202-445e-b6c6-f6973bd31ab2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 14:01:00.736715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: warnings.warn(msg) May 27 14:01:00.736715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: May 27 14:01:00.738755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816baa71-e202-445e-b6c6-f6973bd31ab2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.843285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 768/1562] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:00.844251 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741602-c35d-4d0e-b032-23237ca7422b admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.853612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741602-c35d-4d0e-b032-23237ca7422b admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.858308 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:00.858768 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 795/1563] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:00 2022] PUT /identity/v3/projects/5823c2eec14543e5a2d640fba1fa2276/users/4bb3ef10b30d4609a6ffe3ce28ea8f6c/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:00.860083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181705b-95cc-4989-9210-73a78ee5e09c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.860353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181705b-95cc-4989-9210-73a78ee5e09c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.860633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181705b-95cc-4989-9210-73a78ee5e09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.881669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a181705b-95cc-4989-9210-73a78ee5e09c None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:00.882852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a181705b-95cc-4989-9210-73a78ee5e09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:00.910783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18415-cd2c-4bb6-9384-4d7936a1ebe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.911485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18415-cd2c-4bb6-9384-4d7936a1ebe7 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.911766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18415-cd2c-4bb6-9384-4d7936a1ebe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.912049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18415-cd2c-4bb6-9384-4d7936a1ebe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.912778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a18415-cd2c-4bb6-9384-4d7936a1ebe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:00.913083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a18415-cd2c-4bb6-9384-4d7936a1ebe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.914694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a18415-cd2c-4bb6-9384-4d7936a1ebe7 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.928326 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 769/1564] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:00.930486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18415-cd2c-4bb6-9384-4d7936a1ebe7 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.939792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18415-cd2c-4bb6-9384-4d7936a1ebe7 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.944420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7e1d1-0db7-4cf7-b70a-d5f028ad21e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.945111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7e1d1-0db7-4cf7-b70a-d5f028ad21e4 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.945396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7e1d1-0db7-4cf7-b70a-d5f028ad21e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.945671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7e1d1-0db7-4cf7-b70a-d5f028ad21e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.946382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7e1d1-0db7-4cf7-b70a-d5f028ad21e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:00.946684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7e1d1-0db7-4cf7-b70a-d5f028ad21e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.949014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7e1d1-0db7-4cf7-b70a-d5f028ad21e4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.952213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 796/1565] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:00.953262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181705b-95cc-4989-9210-73a78ee5e09c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.962652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181705b-95cc-4989-9210-73a78ee5e09c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.962831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 770/1566] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:00.965001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7e1d1-0db7-4cf7-b70a-d5f028ad21e4 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.967639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3d673-2ae3-4e6a-99e9-85d737f6ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.968299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3d673-2ae3-4e6a-99e9-85d737f6ed05 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.968580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3d673-2ae3-4e6a-99e9-85d737f6ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.968853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3d673-2ae3-4e6a-99e9-85d737f6ed05 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.969577 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3d673-2ae3-4e6a-99e9-85d737f6ed05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:00.969911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3d673-2ae3-4e6a-99e9-85d737f6ed05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.971581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3d673-2ae3-4e6a-99e9-85d737f6ed05 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.975398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7e1d1-0db7-4cf7-b70a-d5f028ad21e4 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:00.980384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46749ee-b647-419d-aae7-471b441ca1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:00.981028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46749ee-b647-419d-aae7-471b441ca1ed admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:00.981314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46749ee-b647-419d-aae7-471b441ca1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:00.981592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46749ee-b647-419d-aae7-471b441ca1ed admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:00.982311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46749ee-b647-419d-aae7-471b441ca1ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:00.982616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46749ee-b647-419d-aae7-471b441ca1ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:00.990141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 797/1567] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:00.990284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46749ee-b647-419d-aae7-471b441ca1ed admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:00.990396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3d673-2ae3-4e6a-99e9-85d737f6ed05 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:00.997325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 771/1568] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:00.998186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46749ee-b647-419d-aae7-471b441ca1ed admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.005491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3d673-2ae3-4e6a-99e9-85d737f6ed05 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.008099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46749ee-b647-419d-aae7-471b441ca1ed admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.010665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f3b64-cbec-4132-b255-773d4e87547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.011665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f3b64-cbec-4132-b255-773d4e87547d admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.011977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f3b64-cbec-4132-b255-773d4e87547d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.012252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f3b64-cbec-4132-b255-773d4e87547d admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.012967 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f3b64-cbec-4132-b255-773d4e87547d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:01.013273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f3b64-cbec-4132-b255-773d4e87547d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.013381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013014e-a354-4da6-8188-bd4af73619b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.013948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013014e-a354-4da6-8188-bd4af73619b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.014230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013014e-a354-4da6-8188-bd4af73619b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.014509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013014e-a354-4da6-8188-bd4af73619b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.014876 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f3b64-cbec-4132-b255-773d4e87547d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.015261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013014e-a354-4da6-8188-bd4af73619b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.016837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013014e-a354-4da6-8188-bd4af73619b7 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.026703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 772/1569] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:01.027832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 798/1570] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:01.028466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f3b64-cbec-4132-b255-773d4e87547d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.035344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf007-797e-4c0e-8073-5f6d0516d444 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.035640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf007-797e-4c0e-8073-5f6d0516d444 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.035924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cf007-797e-4c0e-8073-5f6d0516d444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.038285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f3b64-cbec-4132-b255-773d4e87547d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.043831 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0956b-c112-413b-af51-82f43d8109b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.044509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0956b-c112-413b-af51-82f43d8109b8 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.044792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0956b-c112-413b-af51-82f43d8109b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.045067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0956b-c112-413b-af51-82f43d8109b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.045751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0956b-c112-413b-af51-82f43d8109b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.047714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0956b-c112-413b-af51-82f43d8109b8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.062540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-807cf007-797e-4c0e-8073-5f6d0516d444 None None] MFA Rules not processed for user `4bb3ef10b30d4609a6ffe3ce28ea8f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:01.063762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-807cf007-797e-4c0e-8073-5f6d0516d444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:01.126516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 773/1571] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:01.127528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cf007-797e-4c0e-8073-5f6d0516d444 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.138596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cf007-797e-4c0e-8073-5f6d0516d444 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.143603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff4b0b-4573-4cd2-b9f6-6050d713acdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.144269 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff4b0b-4573-4cd2-b9f6-6050d713acdb admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.144546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff4b0b-4573-4cd2-b9f6-6050d713acdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.144823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff4b0b-4573-4cd2-b9f6-6050d713acdb admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.145556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff4b0b-4573-4cd2-b9f6-6050d713acdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:01.145854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff4b0b-4573-4cd2-b9f6-6050d713acdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.147484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff4b0b-4573-4cd2-b9f6-6050d713acdb admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.149529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 799/1572] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:01.153777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0956b-c112-413b-af51-82f43d8109b8 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.161142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 774/1573] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:01.161927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff4b0b-4573-4cd2-b9f6-6050d713acdb admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.171889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff4b0b-4573-4cd2-b9f6-6050d713acdb admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.215618 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:01.218387 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0956b-c112-413b-af51-82f43d8109b8 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.223257 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53a3a6-6733-46f9-b29f-5764504cf546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.224226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a3a6-6733-46f9-b29f-5764504cf546 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.224508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a3a6-6733-46f9-b29f-5764504cf546 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.224788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53a3a6-6733-46f9-b29f-5764504cf546 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.225470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53a3a6-6733-46f9-b29f-5764504cf546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.227401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53a3a6-6733-46f9-b29f-5764504cf546 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.230275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902840b1-c604-4b3c-92c9-85ad37b83728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.230948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902840b1-c604-4b3c-92c9-85ad37b83728 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.231266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902840b1-c604-4b3c-92c9-85ad37b83728 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.231551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902840b1-c604-4b3c-92c9-85ad37b83728 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.232248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902840b1-c604-4b3c-92c9-85ad37b83728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.234162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902840b1-c604-4b3c-92c9-85ad37b83728 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.346758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 800/1574] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:01.347623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53a3a6-6733-46f9-b29f-5764504cf546 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.356440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:01.376910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 775/1575] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/projects => generated 369 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:01.380231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902840b1-c604-4b3c-92c9-85ad37b83728 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.408661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53a3a6-6733-46f9-b29f-5764504cf546 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.439263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902840b1-c604-4b3c-92c9-85ad37b83728 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.443836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c346aa-d58b-41aa-9e91-4bcee60430d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.444507 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c346aa-d58b-41aa-9e91-4bcee60430d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.444793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c346aa-d58b-41aa-9e91-4bcee60430d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.445071 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c346aa-d58b-41aa-9e91-4bcee60430d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.445800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c346aa-d58b-41aa-9e91-4bcee60430d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.447636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c346aa-d58b-41aa-9e91-4bcee60430d7 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.457816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 776/1576] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:01.458678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c346aa-d58b-41aa-9e91-4bcee60430d7 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.465723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4da8e8-6241-40e9-860e-cfcf76f32b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.466322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4da8e8-6241-40e9-860e-cfcf76f32b11 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.466608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4da8e8-6241-40e9-860e-cfcf76f32b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.466885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4da8e8-6241-40e9-860e-cfcf76f32b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.467607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4da8e8-6241-40e9-860e-cfcf76f32b11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.468217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c346aa-d58b-41aa-9e91-4bcee60430d7 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.469521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4da8e8-6241-40e9-860e-cfcf76f32b11 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.473592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25e43e-c071-4050-a7f4-eae861c4ad79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.474233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25e43e-c071-4050-a7f4-eae861c4ad79 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.474514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25e43e-c071-4050-a7f4-eae861c4ad79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.474792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25e43e-c071-4050-a7f4-eae861c4ad79 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.475512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25e43e-c071-4050-a7f4-eae861c4ad79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.477406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25e43e-c071-4050-a7f4-eae861c4ad79 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.597458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 801/1577] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:01.598780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104917-bb6b-4bd1-acbb-ef49248e6f0b None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.599096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104917-bb6b-4bd1-acbb-ef49248e6f0b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.599376 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104917-bb6b-4bd1-acbb-ef49248e6f0b None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.600665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 802/1578] 10.222.0.42 () {54 vars in 961 bytes} [Fri May 27 14:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:01:01.601278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104917-bb6b-4bd1-acbb-ef49248e6f0b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.622191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 777/1579] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:01.623356 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25e43e-c071-4050-a7f4-eae861c4ad79 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.677210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104917-bb6b-4bd1-acbb-ef49248e6f0b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.691230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25e43e-c071-4050-a7f4-eae861c4ad79 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.695899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a081aaa-b6ba-45be-842a-d4d5e315ec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.696563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081aaa-b6ba-45be-842a-d4d5e315ec1e admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.696851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081aaa-b6ba-45be-842a-d4d5e315ec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.697159 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a081aaa-b6ba-45be-842a-d4d5e315ec1e admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.697910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a081aaa-b6ba-45be-842a-d4d5e315ec1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.699914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a081aaa-b6ba-45be-842a-d4d5e315ec1e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.720419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:01.733209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75878d5a-7dea-4ba1-8477-535bd157f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.733879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878d5a-7dea-4ba1-8477-535bd157f676 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.734160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878d5a-7dea-4ba1-8477-535bd157f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.734443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75878d5a-7dea-4ba1-8477-535bd157f676 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.735180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75878d5a-7dea-4ba1-8477-535bd157f676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.737077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75878d5a-7dea-4ba1-8477-535bd157f676 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.809532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 778/1580] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:01.810348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a081aaa-b6ba-45be-842a-d4d5e315ec1e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.841185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 803/1581] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:01.841185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75878d5a-7dea-4ba1-8477-535bd157f676 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.843625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:01.848587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75878d5a-7dea-4ba1-8477-535bd157f676 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.876292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a081aaa-b6ba-45be-842a-d4d5e315ec1e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.880866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ee68-387e-4369-a739-8e5b42ce8da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.881538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ee68-387e-4369-a739-8e5b42ce8da1 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.881830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ee68-387e-4369-a739-8e5b42ce8da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.882104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62ee68-387e-4369-a739-8e5b42ce8da1 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.882790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62ee68-387e-4369-a739-8e5b42ce8da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.885060 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62ee68-387e-4369-a739-8e5b42ce8da1 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.904378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9688ea2-ce10-4edb-a9d3-a011def4a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:01.905153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9688ea2-ce10-4edb-a9d3-a011def4a905 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:01.905443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9688ea2-ce10-4edb-a9d3-a011def4a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:01.905718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9688ea2-ce10-4edb-a9d3-a011def4a905 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:01.906548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9688ea2-ce10-4edb-a9d3-a011def4a905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:01.908510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9688ea2-ce10-4edb-a9d3-a011def4a905 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:01.986372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 779/1582] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:01.987256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ee68-387e-4369-a739-8e5b42ce8da1 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:01.997450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62ee68-387e-4369-a739-8e5b42ce8da1 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:01.997853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 804/1583] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:01.998652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9688ea2-ce10-4edb-a9d3-a011def4a905 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.002203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e004cc7-c5cb-4df7-807b-47bbb15e16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.003121 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e004cc7-c5cb-4df7-807b-47bbb15e16f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.003410 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e004cc7-c5cb-4df7-807b-47bbb15e16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.003688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e004cc7-c5cb-4df7-807b-47bbb15e16f6 admin admin] PATH_INFO: `/v3/projects/fd46f9321b0a4f3b8e5b46ea83a49d2a/users/a0a7beec276446abbfcaebf6d0dad46a/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.008160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9688ea2-ce10-4edb-a9d3-a011def4a905 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.013217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941b717-ed7c-4c6f-80c3-95e21fb4b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.016236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b717-ed7c-4c6f-80c3-95e21fb4b8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.016236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b717-ed7c-4c6f-80c3-95e21fb4b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.016236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941b717-ed7c-4c6f-80c3-95e21fb4b8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.016236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941b717-ed7c-4c6f-80c3-95e21fb4b8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.017110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941b717-ed7c-4c6f-80c3-95e21fb4b8f6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.020125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e004cc7-c5cb-4df7-807b-47bbb15e16f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd46f9321b0a4f3b8e5b46ea83a49d2a, user_id=a0a7beec276446abbfcaebf6d0dad46a, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.022769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e004cc7-c5cb-4df7-807b-47bbb15e16f6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.109087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 805/1584] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:01 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:02.109280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 780/1585] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:01 2022] PUT /identity/v3/projects/fd46f9321b0a4f3b8e5b46ea83a49d2a/users/a0a7beec276446abbfcaebf6d0dad46a/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:02.109280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e004cc7-c5cb-4df7-807b-47bbb15e16f6 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.110202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b946d9-f8a4-4c80-ae31-3959e9bc8f21 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.110202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b946d9-f8a4-4c80-ae31-3959e9bc8f21 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.110202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b946d9-f8a4-4c80-ae31-3959e9bc8f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.126715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-71b946d9-f8a4-4c80-ae31-3959e9bc8f21 None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:02.128008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-71b946d9-f8a4-4c80-ae31-3959e9bc8f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:02.172986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e004cc7-c5cb-4df7-807b-47bbb15e16f6 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.177627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a468-364e-44ce-961d-f8adc020acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.178339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a468-364e-44ce-961d-f8adc020acbf admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.178699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a468-364e-44ce-961d-f8adc020acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.178995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797a468-364e-44ce-961d-f8adc020acbf admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.179687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797a468-364e-44ce-961d-f8adc020acbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.182426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797a468-364e-44ce-961d-f8adc020acbf admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.194173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 806/1586] 10.222.0.42 () {58 vars in 1058 bytes} [Fri May 27 14:01:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:02.198630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b946d9-f8a4-4c80-ae31-3959e9bc8f21 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.205954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b946d9-f8a4-4c80-ae31-3959e9bc8f21 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.210512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dc9bd-26aa-40de-aff4-3fb69aa2048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.211193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dc9bd-26aa-40de-aff4-3fb69aa2048c admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.211477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dc9bd-26aa-40de-aff4-3fb69aa2048c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.211751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00dc9bd-26aa-40de-aff4-3fb69aa2048c admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.212456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dc9bd-26aa-40de-aff4-3fb69aa2048c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.214649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00dc9bd-26aa-40de-aff4-3fb69aa2048c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.310733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 781/1587] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:02 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:02.311707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a468-364e-44ce-961d-f8adc020acbf admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.321610 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797a468-364e-44ce-961d-f8adc020acbf admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.326273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423a4b2-54d4-41f4-99a0-1565305a4e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.326906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423a4b2-54d4-41f4-99a0-1565305a4e96 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.327218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423a4b2-54d4-41f4-99a0-1565305a4e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.327490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423a4b2-54d4-41f4-99a0-1565305a4e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.328450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423a4b2-54d4-41f4-99a0-1565305a4e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.330026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423a4b2-54d4-41f4-99a0-1565305a4e96 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.339860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 782/1588] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.346272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423a4b2-54d4-41f4-99a0-1565305a4e96 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.346606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 807/1589] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:02 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:02.347823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dc9bd-26aa-40de-aff4-3fb69aa2048c admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.350269 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423a4b2-54d4-41f4-99a0-1565305a4e96 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.355715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15612d3a-8dda-4fee-a5ba-35ab239aca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.356361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612d3a-8dda-4fee-a5ba-35ab239aca11 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.356645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612d3a-8dda-4fee-a5ba-35ab239aca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.356941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612d3a-8dda-4fee-a5ba-35ab239aca11 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.357660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15612d3a-8dda-4fee-a5ba-35ab239aca11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.358950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00dc9bd-26aa-40de-aff4-3fb69aa2048c admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.359273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15612d3a-8dda-4fee-a5ba-35ab239aca11 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.363895 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b216ee-d69d-4abb-933d-07a75c3e27a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.364547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b216ee-d69d-4abb-933d-07a75c3e27a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.364833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b216ee-d69d-4abb-933d-07a75c3e27a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.365106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b216ee-d69d-4abb-933d-07a75c3e27a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.365829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b216ee-d69d-4abb-933d-07a75c3e27a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.367426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b216ee-d69d-4abb-933d-07a75c3e27a4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.369863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 783/1590] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.373599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15612d3a-8dda-4fee-a5ba-35ab239aca11 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.378373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 808/1591] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.379761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622a4e-33a9-4e6c-8566-25785ed006bd None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.380116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622a4e-33a9-4e6c-8566-25785ed006bd None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.386356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4622a4e-33a9-4e6c-8566-25785ed006bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.386481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15612d3a-8dda-4fee-a5ba-35ab239aca11 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.390419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720fb67-698b-4f62-9135-2563188a388e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.391106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720fb67-698b-4f62-9135-2563188a388e admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.391392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720fb67-698b-4f62-9135-2563188a388e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.391677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720fb67-698b-4f62-9135-2563188a388e admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.392406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720fb67-698b-4f62-9135-2563188a388e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.394079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720fb67-698b-4f62-9135-2563188a388e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.397985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f4622a4e-33a9-4e6c-8566-25785ed006bd None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:02.399279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f4622a4e-33a9-4e6c-8566-25785ed006bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:02.405946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 784/1592] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.406804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720fb67-698b-4f62-9135-2563188a388e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.407925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 809/1593] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:02.408654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4622a4e-33a9-4e6c-8566-25785ed006bd None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.414842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:02.419545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4622a4e-33a9-4e6c-8566-25785ed006bd None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.420244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720fb67-698b-4f62-9135-2563188a388e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.424232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982e473-6247-4959-a130-21a19eb93e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.427931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982e473-6247-4959-a130-21a19eb93e07 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.427931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982e473-6247-4959-a130-21a19eb93e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.427931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982e473-6247-4959-a130-21a19eb93e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.428206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4cdd5-b61e-4143-80ff-c847c1e1f89f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.428316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982e473-6247-4959-a130-21a19eb93e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.428420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4cdd5-b61e-4143-80ff-c847c1e1f89f service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.428420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4cdd5-b61e-4143-80ff-c847c1e1f89f service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.428420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4cdd5-b61e-4143-80ff-c847c1e1f89f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.428664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9982e473-6247-4959-a130-21a19eb93e07 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.437856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 810/1594] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.441567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982e473-6247-4959-a130-21a19eb93e07 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.451611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982e473-6247-4959-a130-21a19eb93e07 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.456916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277c205-ddb7-4265-a586-29a945296e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.457561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277c205-ddb7-4265-a586-29a945296e37 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.457841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277c205-ddb7-4265-a586-29a945296e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.458113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277c205-ddb7-4265-a586-29a945296e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.458826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277c205-ddb7-4265-a586-29a945296e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.460436 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277c205-ddb7-4265-a586-29a945296e37 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.471911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 811/1595] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.472734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277c205-ddb7-4265-a586-29a945296e37 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.476234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:02.482807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277c205-ddb7-4265-a586-29a945296e37 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.487765 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253d6a-a80d-4285-a033-b5f159ccfd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.488123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4cdd5-b61e-4143-80ff-c847c1e1f89f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.488401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253d6a-a80d-4285-a033-b5f159ccfd57 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.488683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253d6a-a80d-4285-a033-b5f159ccfd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.488957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253d6a-a80d-4285-a033-b5f159ccfd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.489699 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99253d6a-a80d-4285-a033-b5f159ccfd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.489808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4cdd5-b61e-4143-80ff-c847c1e1f89f service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.491283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99253d6a-a80d-4285-a033-b5f159ccfd57 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.498884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 785/1596] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:02.499821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4cdd5-b61e-4143-80ff-c847c1e1f89f service nova] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.504290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 812/1597] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.504290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253d6a-a80d-4285-a033-b5f159ccfd57 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.509923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4cdd5-b61e-4143-80ff-c847c1e1f89f service nova] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.513744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99253d6a-a80d-4285-a033-b5f159ccfd57 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.514556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a76c5a-b9fc-4324-9efb-91493d640b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.515391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a76c5a-b9fc-4324-9efb-91493d640b13 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.515679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a76c5a-b9fc-4324-9efb-91493d640b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.515961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a76c5a-b9fc-4324-9efb-91493d640b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.516683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a76c5a-b9fc-4324-9efb-91493d640b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.518267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a76c5a-b9fc-4324-9efb-91493d640b13 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.519295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0f474-ab7d-442b-b23e-b5d174a0a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.520004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0f474-ab7d-442b-b23e-b5d174a0a344 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.520356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0f474-ab7d-442b-b23e-b5d174a0a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.520744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0f474-ab7d-442b-b23e-b5d174a0a344 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.521566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0f474-ab7d-442b-b23e-b5d174a0a344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.523555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0f474-ab7d-442b-b23e-b5d174a0a344 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.529973 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 786/1598] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.530960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a76c5a-b9fc-4324-9efb-91493d640b13 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.538829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 813/1599] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.541724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a76c5a-b9fc-4324-9efb-91493d640b13 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.543389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0f474-ab7d-442b-b23e-b5d174a0a344 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.546691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3c4f0-e479-47c4-aae5-12db710bacb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.547506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3c4f0-e479-47c4-aae5-12db710bacb2 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.547790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3c4f0-e479-47c4-aae5-12db710bacb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.548088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3c4f0-e479-47c4-aae5-12db710bacb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.548897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3c4f0-e479-47c4-aae5-12db710bacb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.550438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3c4f0-e479-47c4-aae5-12db710bacb2 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.561532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 787/1600] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.562297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3c4f0-e479-47c4-aae5-12db710bacb2 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.572289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3c4f0-e479-47c4-aae5-12db710bacb2 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.577388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71741f00-df88-4388-aebc-3b75af229617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.578327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71741f00-df88-4388-aebc-3b75af229617 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.578679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71741f00-df88-4388-aebc-3b75af229617 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.578957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71741f00-df88-4388-aebc-3b75af229617 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.579793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71741f00-df88-4388-aebc-3b75af229617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.581383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71741f00-df88-4388-aebc-3b75af229617 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.593459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 788/1601] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.594331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71741f00-df88-4388-aebc-3b75af229617 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.604551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71741f00-df88-4388-aebc-3b75af229617 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.608401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0f474-ab7d-442b-b23e-b5d174a0a344 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.609258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ff9c6-8845-4df1-924e-c6f49f30b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.610122 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ff9c6-8845-4df1-924e-c6f49f30b6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.610404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ff9c6-8845-4df1-924e-c6f49f30b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.610677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ff9c6-8845-4df1-924e-c6f49f30b6e2 admin admin] PATH_INFO: `/v3/projects/8db67f9819884a81a11772326e287481/users/2e7ba82a80834a4aa098e9604165cfad/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.612439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ec551-30ae-47db-be69-959d036055bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.613144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ec551-30ae-47db-be69-959d036055bd service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.613599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ec551-30ae-47db-be69-959d036055bd service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.613937 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ec551-30ae-47db-be69-959d036055bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.624544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ec551-30ae-47db-be69-959d036055bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.625826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ff9c6-8845-4df1-924e-c6f49f30b6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db67f9819884a81a11772326e287481, user_id=2e7ba82a80834a4aa098e9604165cfad, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.626343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ec551-30ae-47db-be69-959d036055bd service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.628578 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ff9c6-8845-4df1-924e-c6f49f30b6e2 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.637222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 814/1602] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:02.638103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ec551-30ae-47db-be69-959d036055bd service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.649731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ec551-30ae-47db-be69-959d036055bd service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.654502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109263bf-2362-43a0-84b1-e78a53875856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.655585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109263bf-2362-43a0-84b1-e78a53875856 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.655585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109263bf-2362-43a0-84b1-e78a53875856 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.655979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109263bf-2362-43a0-84b1-e78a53875856 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.657007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109263bf-2362-43a0-84b1-e78a53875856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.658812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109263bf-2362-43a0-84b1-e78a53875856 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.671185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 815/1603] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:02.671185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109263bf-2362-43a0-84b1-e78a53875856 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.680925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109263bf-2362-43a0-84b1-e78a53875856 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.685874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485f0a2-9668-4b62-9d49-983cc72a381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.686747 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485f0a2-9668-4b62-9d49-983cc72a381d admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.687169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485f0a2-9668-4b62-9d49-983cc72a381d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.687612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485f0a2-9668-4b62-9d49-983cc72a381d admin admin] PATH_INFO: `/v3/projects/a5d08d90c991476c9e4292b90aa82e14/users/570453a990b2423eb319921f13054791/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.702156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485f0a2-9668-4b62-9d49-983cc72a381d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d08d90c991476c9e4292b90aa82e14, user_id=570453a990b2423eb319921f13054791, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.705316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485f0a2-9668-4b62-9d49-983cc72a381d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.712688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 789/1604] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:02 2022] PUT /identity/v3/projects/8db67f9819884a81a11772326e287481/users/2e7ba82a80834a4aa098e9604165cfad/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:02.714513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ff9c6-8845-4df1-924e-c6f49f30b6e2 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.779607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ff9c6-8845-4df1-924e-c6f49f30b6e2 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.784229 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a37bb0-813f-4152-a153-7be1b7b937aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.785160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a37bb0-813f-4152-a153-7be1b7b937aa admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.790552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a37bb0-813f-4152-a153-7be1b7b937aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.790552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a37bb0-813f-4152-a153-7be1b7b937aa admin admin] PATH_INFO: `/v3/projects/b300fa9b3cca466fade2c5cab0bf53db/users/5ce1cc68c4164d7fa09506b25c959374/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.800597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a37bb0-813f-4152-a153-7be1b7b937aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b300fa9b3cca466fade2c5cab0bf53db, user_id=5ce1cc68c4164d7fa09506b25c959374, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.803360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a37bb0-813f-4152-a153-7be1b7b937aa admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.836954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 816/1605] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:02 2022] PUT /identity/v3/projects/a5d08d90c991476c9e4292b90aa82e14/users/570453a990b2423eb319921f13054791/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:02.838478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485f0a2-9668-4b62-9d49-983cc72a381d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.896682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 790/1606] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:02 2022] PUT /identity/v3/projects/b300fa9b3cca466fade2c5cab0bf53db/users/5ce1cc68c4164d7fa09506b25c959374/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:02.898255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a37bb0-813f-4152-a153-7be1b7b937aa admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:02.900266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485f0a2-9668-4b62-9d49-983cc72a381d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.935244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:02.965353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de8852-654a-40b7-992f-61536403687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.967119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de8852-654a-40b7-992f-61536403687c admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.968403 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de8852-654a-40b7-992f-61536403687c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.968403 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de8852-654a-40b7-992f-61536403687c admin admin] PATH_INFO: `/v3/projects/9c30692586604d5b9b3a99913da0429a/users/f77a4ee31a9e48d18a3be08267eb6236/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:02.985912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a37bb0-813f-4152-a153-7be1b7b937aa admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:02.987098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de8852-654a-40b7-992f-61536403687c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c30692586604d5b9b3a99913da0429a, user_id=f77a4ee31a9e48d18a3be08267eb6236, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:02.989824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de8852-654a-40b7-992f-61536403687c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:02.990662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c4913-0bae-4718-96ef-55266d704142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:02.991590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c4913-0bae-4718-96ef-55266d704142 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:02.991873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c4913-0bae-4718-96ef-55266d704142 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:02.992154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c4913-0bae-4718-96ef-55266d704142 admin admin] PATH_INFO: `/v3/projects/f27369801b1143a78ddd92d4ef6464cc/users/d89848987ecc4caa91ea69731b947ffd/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.008514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c4913-0bae-4718-96ef-55266d704142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27369801b1143a78ddd92d4ef6464cc, user_id=d89848987ecc4caa91ea69731b947ffd, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:03.011322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c4913-0bae-4718-96ef-55266d704142 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:03.015467 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:03.134247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 817/1607] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:02 2022] PUT /identity/v3/projects/9c30692586604d5b9b3a99913da0429a/users/f77a4ee31a9e48d18a3be08267eb6236/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:03.136005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de8852-654a-40b7-992f-61536403687c admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:03.189551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 791/1608] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:02 2022] PUT /identity/v3/projects/f27369801b1143a78ddd92d4ef6464cc/users/d89848987ecc4caa91ea69731b947ffd/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:03.189551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be9103-be20-4aec-94e4-24daa73361f5 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.189551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be9103-be20-4aec-94e4-24daa73361f5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.189551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be9103-be20-4aec-94e4-24daa73361f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.202961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f9be9103-be20-4aec-94e4-24daa73361f5 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:03.204595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f9be9103-be20-4aec-94e4-24daa73361f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:03.214325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de8852-654a-40b7-992f-61536403687c admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:03.271781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 792/1609] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:03.273488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fb73-76bc-41c9-a269-f362da9b588e None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.273992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fb73-76bc-41c9-a269-f362da9b588e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.274427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62fb73-76bc-41c9-a269-f362da9b588e None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.280588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 793/1610] 10.222.0.42 () {54 vars in 912 bytes} [Fri May 27 14:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:01:03.280588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ece87-023d-4d90-940b-65199e002c45 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.280588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ece87-023d-4d90-940b-65199e002c45 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.280588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ece87-023d-4d90-940b-65199e002c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.311764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-042ece87-023d-4d90-940b-65199e002c45 None None] MFA Rules not processed for user `570453a990b2423eb319921f13054791`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:03.313057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-042ece87-023d-4d90-940b-65199e002c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:03.402943 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 794/1611] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:03.406396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436de6-2181-48db-a82b-ca9dd21b98c2 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.406851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436de6-2181-48db-a82b-ca9dd21b98c2 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.407768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8436de6-2181-48db-a82b-ca9dd21b98c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.422382 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82929052-e8d0-4200-9bda-8c38d508a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:03.423362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82929052-e8d0-4200-9bda-8c38d508a246 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.423650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82929052-e8d0-4200-9bda-8c38d508a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.423938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82929052-e8d0-4200-9bda-8c38d508a246 admin admin] PATH_INFO: `/v3/projects/191298ea8b7d48f981aa4abf8b154b55/users/7caf8c01365b4918abf24203b7a14dfa/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.440331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-c8436de6-2181-48db-a82b-ca9dd21b98c2 None None] MFA Rules not processed for user `5ce1cc68c4164d7fa09506b25c959374`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:03.442047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82929052-e8d0-4200-9bda-8c38d508a246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=191298ea8b7d48f981aa4abf8b154b55, user_id=7caf8c01365b4918abf24203b7a14dfa, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:03.442210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c8436de6-2181-48db-a82b-ca9dd21b98c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:03.443393 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82929052-e8d0-4200-9bda-8c38d508a246 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:03.509076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 795/1612] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:03.510865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ba70-0baa-4097-8267-108818591906 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.511401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ba70-0baa-4097-8267-108818591906 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.511686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ba70-0baa-4097-8267-108818591906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.529009 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a512ba70-0baa-4097-8267-108818591906 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:03.530220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a512ba70-0baa-4097-8267-108818591906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:03.538363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 796/1613] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:03.539761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc6f3-7829-4dbe-ad51-36fa2fde85d9 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.540249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc6f3-7829-4dbe-ad51-36fa2fde85d9 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.540462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfc6f3-7829-4dbe-ad51-36fa2fde85d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.560472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:03.570248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-eabfc6f3-7829-4dbe-ad51-36fa2fde85d9 None None] MFA Rules not processed for user `d89848987ecc4caa91ea69731b947ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:03.576593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-eabfc6f3-7829-4dbe-ad51-36fa2fde85d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:03.576728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 818/1614] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:03 2022] PUT /identity/v3/projects/191298ea8b7d48f981aa4abf8b154b55/users/7caf8c01365b4918abf24203b7a14dfa/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:03.576728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a16a0c-7e10-47d8-9dc2-d2c67da4ba5f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.576728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a16a0c-7e10-47d8-9dc2-d2c67da4ba5f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.576728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a16a0c-7e10-47d8-9dc2-d2c67da4ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.598216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-29a16a0c-7e10-47d8-9dc2-d2c67da4ba5f None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:03.599825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-29a16a0c-7e10-47d8-9dc2-d2c67da4ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:03.655035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 797/1615] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:03.656003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc6f3-7829-4dbe-ad51-36fa2fde85d9 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:03.657422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-eabfc6f3-7829-4dbe-ad51-36fa2fde85d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:03.661228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:03.685554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 819/1616] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:03.686428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a16a0c-7e10-47d8-9dc2-d2c67da4ba5f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:03.728884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfc6f3-7829-4dbe-ad51-36fa2fde85d9 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:03.732527 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbdefa-c1e3-4416-affb-f7b989e43049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:03.733172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbdefa-c1e3-4416-affb-f7b989e43049 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.733452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbdefa-c1e3-4416-affb-f7b989e43049 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.733730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbdefa-c1e3-4416-affb-f7b989e43049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.743559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a16a0c-7e10-47d8-9dc2-d2c67da4ba5f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:03.747319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a9fa1-a79d-4eca-950b-77d473c7afd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:03.747963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a9fa1-a79d-4eca-950b-77d473c7afd4 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.748245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a9fa1-a79d-4eca-950b-77d473c7afd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.748518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a9fa1-a79d-4eca-950b-77d473c7afd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.797909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbdefa-c1e3-4416-affb-f7b989e43049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:03.799541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbdefa-c1e3-4416-affb-f7b989e43049 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:03.808511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a9fa1-a79d-4eca-950b-77d473c7afd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:03.810077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a9fa1-a79d-4eca-950b-77d473c7afd4 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:03.812222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 798/1617] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:03.813041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbdefa-c1e3-4416-affb-f7b989e43049 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:03.821330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 820/1618] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:03.822777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a9fa1-a79d-4eca-950b-77d473c7afd4 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:03.823387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbdefa-c1e3-4416-affb-f7b989e43049 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:03.829135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36916e-ac2a-42b8-bfce-73fe2160662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:03.843220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36916e-ac2a-42b8-bfce-73fe2160662f admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.843220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36916e-ac2a-42b8-bfce-73fe2160662f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.843220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36916e-ac2a-42b8-bfce-73fe2160662f admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.843220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36916e-ac2a-42b8-bfce-73fe2160662f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:03.844277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a9fa1-a79d-4eca-950b-77d473c7afd4 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:03.844373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36916e-ac2a-42b8-bfce-73fe2160662f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:03.844470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa596d-094c-460d-bf1d-18bab1629ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:03.844470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa596d-094c-460d-bf1d-18bab1629ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.844470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa596d-094c-460d-bf1d-18bab1629ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.844470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa596d-094c-460d-bf1d-18bab1629ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.850081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa596d-094c-460d-bf1d-18bab1629ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:03.851897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa596d-094c-460d-bf1d-18bab1629ad5 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:03.865098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 821/1619] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:03.866754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6132-6a4c-47ed-8392-09dd5c057204 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.870469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6132-6a4c-47ed-8392-09dd5c057204 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.870469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6132-6a4c-47ed-8392-09dd5c057204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.891129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d79b6132-6a4c-47ed-8392-09dd5c057204 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:03.892699 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d79b6132-6a4c-47ed-8392-09dd5c057204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:03.903221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 822/1620] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:03.904084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6132-6a4c-47ed-8392-09dd5c057204 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:03.914236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6132-6a4c-47ed-8392-09dd5c057204 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:03.919459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8b76b-77d3-44f7-881d-1181d8976885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:03.920144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b76b-77d3-44f7-881d-1181d8976885 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:03.920429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b76b-77d3-44f7-881d-1181d8976885 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:03.920703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8b76b-77d3-44f7-881d-1181d8976885 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:03.921410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8b76b-77d3-44f7-881d-1181d8976885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:03.923400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8b76b-77d3-44f7-881d-1181d8976885 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:03.948616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 799/1621] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:03 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:03.952391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36916e-ac2a-42b8-bfce-73fe2160662f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:04.019261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:04.044958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 823/1622] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:03 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:04.044958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8b76b-77d3-44f7-881d-1181d8976885 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:04.057938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36916e-ac2a-42b8-bfce-73fe2160662f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:04.202640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8b76b-77d3-44f7-881d-1181d8976885 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:04.203466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6af4b-ed49-4c96-be64-a4f182729a86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:04.203466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6af4b-ed49-4c96-be64-a4f182729a86 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.203466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6af4b-ed49-4c96-be64-a4f182729a86 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.203466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6af4b-ed49-4c96-be64-a4f182729a86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.203945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36641b-4d91-4daa-ad4d-0f40ac45e185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:04.203945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36641b-4d91-4daa-ad4d-0f40ac45e185 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.203945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36641b-4d91-4daa-ad4d-0f40ac45e185 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.203945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36641b-4d91-4daa-ad4d-0f40ac45e185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.204299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:04.260894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36641b-4d91-4daa-ad4d-0f40ac45e185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:04.262338 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36641b-4d91-4daa-ad4d-0f40ac45e185 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:04.272193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 824/1623] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:04.272988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36641b-4d91-4daa-ad4d-0f40ac45e185 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:04.277705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6af4b-ed49-4c96-be64-a4f182729a86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:04.279643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6af4b-ed49-4c96-be64-a4f182729a86 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:04.282135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36641b-4d91-4daa-ad4d-0f40ac45e185 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:04.287103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16835003-9873-40fc-9bbe-2fc33bf64736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:04.287840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16835003-9873-40fc-9bbe-2fc33bf64736 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.288140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16835003-9873-40fc-9bbe-2fc33bf64736 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.288401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16835003-9873-40fc-9bbe-2fc33bf64736 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.289097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16835003-9873-40fc-9bbe-2fc33bf64736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:04.292070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16835003-9873-40fc-9bbe-2fc33bf64736 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:04.299479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 800/1624] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:04.300641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6af4b-ed49-4c96-be64-a4f182729a86 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:04.323823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6af4b-ed49-4c96-be64-a4f182729a86 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:04.328912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64a93-0962-4881-8e91-6e4014cfe749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:04.329589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64a93-0962-4881-8e91-6e4014cfe749 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.329877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64a93-0962-4881-8e91-6e4014cfe749 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.330157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64a93-0962-4881-8e91-6e4014cfe749 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.330855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b64a93-0962-4881-8e91-6e4014cfe749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:04.332891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b64a93-0962-4881-8e91-6e4014cfe749 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:04.476761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 825/1625] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:04 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:04.479011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 801/1626] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:04 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:04.483978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd57350-edbc-4608-b50b-8dbf8fb413e3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.484195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64a93-0962-4881-8e91-6e4014cfe749 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:04.484715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd57350-edbc-4608-b50b-8dbf8fb413e3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.485194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd57350-edbc-4608-b50b-8dbf8fb413e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.498470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64a93-0962-4881-8e91-6e4014cfe749 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:04.505946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b3f70-55b2-46aa-b613-ee05d1f919ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:04.507246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b3f70-55b2-46aa-b613-ee05d1f919ef admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.507537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b3f70-55b2-46aa-b613-ee05d1f919ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.507815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b3f70-55b2-46aa-b613-ee05d1f919ef admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.508560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b3f70-55b2-46aa-b613-ee05d1f919ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:04.510589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b3f70-55b2-46aa-b613-ee05d1f919ef admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:04.530615 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 802/1627] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:04.530955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7cd57350-edbc-4608-b50b-8dbf8fb413e3 None None] MFA Rules not processed for user `a0a7beec276446abbfcaebf6d0dad46a`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:04.531531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b3f70-55b2-46aa-b613-ee05d1f919ef admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:04.532812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7cd57350-edbc-4608-b50b-8dbf8fb413e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:04.546403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b3f70-55b2-46aa-b613-ee05d1f919ef admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:04.552265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fec3b-bc82-44ff-91cf-fbc8a76dd48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:04.552710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fec3b-bc82-44ff-91cf-fbc8a76dd48d admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.553104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fec3b-bc82-44ff-91cf-fbc8a76dd48d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.553382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fec3b-bc82-44ff-91cf-fbc8a76dd48d admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.554105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fec3b-bc82-44ff-91cf-fbc8a76dd48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:04.556093 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fec3b-bc82-44ff-91cf-fbc8a76dd48d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:04.575563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 803/1628] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:04.575563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fec3b-bc82-44ff-91cf-fbc8a76dd48d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:04.586208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fec3b-bc82-44ff-91cf-fbc8a76dd48d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:04.589852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871ed2a-821e-490d-a7c4-cfe25242d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:04.590729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ed2a-821e-490d-a7c4-cfe25242d78d admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.591034 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ed2a-821e-490d-a7c4-cfe25242d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.591309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871ed2a-821e-490d-a7c4-cfe25242d78d admin admin] PATH_INFO: `/v3/projects/084a90bcf16345fb821d7ede7b0280a7/users/df80f0ce5b304334a3ecdfd26d6cb75b/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.627863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ed2a-821e-490d-a7c4-cfe25242d78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=084a90bcf16345fb821d7ede7b0280a7, user_id=df80f0ce5b304334a3ecdfd26d6cb75b, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:04.630594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871ed2a-821e-490d-a7c4-cfe25242d78d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:04.643011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 826/1629] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:04.643011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd57350-edbc-4608-b50b-8dbf8fb413e3 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:04.664475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd57350-edbc-4608-b50b-8dbf8fb413e3 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:04.678484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eee304-21cc-422d-9134-c02dc6b58f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:04.679682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee304-21cc-422d-9134-c02dc6b58f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.680179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee304-21cc-422d-9134-c02dc6b58f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.680597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eee304-21cc-422d-9134-c02dc6b58f26 admin admin] PATH_INFO: `/v3/projects/34c860a54119433ca70afe10f98e8534/users/c5c79bb549aa4e0e84a5cb600e22fbb7/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.701515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eee304-21cc-422d-9134-c02dc6b58f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c860a54119433ca70afe10f98e8534, user_id=c5c79bb549aa4e0e84a5cb600e22fbb7, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:04.704626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eee304-21cc-422d-9134-c02dc6b58f26 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:04.760979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 804/1630] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:04 2022] PUT /identity/v3/projects/084a90bcf16345fb821d7ede7b0280a7/users/df80f0ce5b304334a3ecdfd26d6cb75b/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:04.762028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f583-d3c2-45c6-bfbc-d72b1cac7c1a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.762320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f583-d3c2-45c6-bfbc-d72b1cac7c1a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.762599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780f583-d3c2-45c6-bfbc-d72b1cac7c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.799297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-2780f583-d3c2-45c6-bfbc-d72b1cac7c1a None None] MFA Rules not processed for user `a0a7beec276446abbfcaebf6d0dad46a`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:04.800547 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2780f583-d3c2-45c6-bfbc-d72b1cac7c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:04.816220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:04.848643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 827/1631] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:04 2022] PUT /identity/v3/projects/34c860a54119433ca70afe10f98e8534/users/c5c79bb549aa4e0e84a5cb600e22fbb7/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:04.849519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eee304-21cc-422d-9134-c02dc6b58f26 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:04.891491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 805/1632] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:04.893062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780f583-d3c2-45c6-bfbc-d72b1cac7c1a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:04.923142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:04.937590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eee304-21cc-422d-9134-c02dc6b58f26 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:04.945981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad571080-b842-494f-be7a-5f4b758bb75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:04.947013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad571080-b842-494f-be7a-5f4b758bb75c admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.947525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad571080-b842-494f-be7a-5f4b758bb75c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.948019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad571080-b842-494f-be7a-5f4b758bb75c admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.949330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad571080-b842-494f-be7a-5f4b758bb75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:04.951665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad571080-b842-494f-be7a-5f4b758bb75c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:04.968199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 828/1633] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:04.970248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fe287-df87-429e-b655-beb4f196076d None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:04.970709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fe287-df87-429e-b655-beb4f196076d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:04.971448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fe287-df87-429e-b655-beb4f196076d None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:04.979198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 829/1634] 10.222.0.42 () {54 vars in 961 bytes} [Fri May 27 14:01:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:01:04.980455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fe287-df87-429e-b655-beb4f196076d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:05.003358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fe287-df87-429e-b655-beb4f196076d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:05.007437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780f583-d3c2-45c6-bfbc-d72b1cac7c1a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:05.013875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa55ed-0f60-4871-9b46-c75f7bdc60b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:05.015101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa55ed-0f60-4871-9b46-c75f7bdc60b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.015388 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa55ed-0f60-4871-9b46-c75f7bdc60b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.015760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa55ed-0f60-4871-9b46-c75f7bdc60b3 admin admin] PATH_INFO: `/v3/projects/084a90bcf16345fb821d7ede7b0280a7/users/df80f0ce5b304334a3ecdfd26d6cb75b/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.018004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afca01-90eb-430b-ae26-5c3030c28b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:05.019143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afca01-90eb-430b-ae26-5c3030c28b50 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.019254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa55ed-0f60-4871-9b46-c75f7bdc60b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084a90bcf16345fb821d7ede7b0280a7, user_id=df80f0ce5b304334a3ecdfd26d6cb75b, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:05.019558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afca01-90eb-430b-ae26-5c3030c28b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.020028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afca01-90eb-430b-ae26-5c3030c28b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.020927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afca01-90eb-430b-ae26-5c3030c28b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:05.022073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa55ed-0f60-4871-9b46-c75f7bdc60b3 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:05.022729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afca01-90eb-430b-ae26-5c3030c28b50 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:05.046275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 806/1635] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:05.046494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 830/1636] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:04 2022] PUT /identity/v3/projects/084a90bcf16345fb821d7ede7b0280a7/users/df80f0ce5b304334a3ecdfd26d6cb75b/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:05.046983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60e89e-ff32-4326-903a-98abddffcb6d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.046983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60e89e-ff32-4326-903a-98abddffcb6d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.046983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60e89e-ff32-4326-903a-98abddffcb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.059944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9d81-6589-4c68-aca8-476c1e32f439 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.060267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9d81-6589-4c68-aca8-476c1e32f439 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.060466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3a60e89e-ff32-4326-903a-98abddffcb6d None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:05.060572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad9d81-6589-4c68-aca8-476c1e32f439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.061735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3a60e89e-ff32-4326-903a-98abddffcb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:05.098425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-dcad9d81-6589-4c68-aca8-476c1e32f439 None None] MFA Rules not processed for user `df80f0ce5b304334a3ecdfd26d6cb75b`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:05.100109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-dcad9d81-6589-4c68-aca8-476c1e32f439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:05.174723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 807/1637] 10.222.0.42 () {58 vars in 1058 bytes} [Fri May 27 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:05.182825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60e89e-ff32-4326-903a-98abddffcb6d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:05.260823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 831/1638] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:05.262366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad9d81-6589-4c68-aca8-476c1e32f439 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:05.286150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad9d81-6589-4c68-aca8-476c1e32f439 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:05.289820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60e89e-ff32-4326-903a-98abddffcb6d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:05.294010 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3f55e-199b-483d-8270-c777a0e9305c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:05.295247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3f55e-199b-483d-8270-c777a0e9305c service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.295599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3f55e-199b-483d-8270-c777a0e9305c service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.295941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3f55e-199b-483d-8270-c777a0e9305c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.296342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b010090-0ca2-43c3-90aa-742a74d85196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:05.297315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b010090-0ca2-43c3-90aa-742a74d85196 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.297696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b010090-0ca2-43c3-90aa-742a74d85196 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.298132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b010090-0ca2-43c3-90aa-742a74d85196 admin admin] PATH_INFO: `/v3/projects/34c860a54119433ca70afe10f98e8534/users/c5c79bb549aa4e0e84a5cb600e22fbb7/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.300201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b010090-0ca2-43c3-90aa-742a74d85196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c860a54119433ca70afe10f98e8534, user_id=c5c79bb549aa4e0e84a5cb600e22fbb7, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:05.303436 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b010090-0ca2-43c3-90aa-742a74d85196 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:05.343135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 808/1639] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:05 2022] PUT /identity/v3/projects/34c860a54119433ca70afe10f98e8534/users/c5c79bb549aa4e0e84a5cb600e22fbb7/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:05.344377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b010090-0ca2-43c3-90aa-742a74d85196 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:05.401325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3f55e-199b-483d-8270-c777a0e9305c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:05.419559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3f55e-199b-483d-8270-c777a0e9305c service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:05.419559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 832/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:05.420903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ceb85-8c06-43e5-bb9e-64f66dcbded1 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.420903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ceb85-8c06-43e5-bb9e-64f66dcbded1 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.421360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ceb85-8c06-43e5-bb9e-64f66dcbded1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.480494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-256ceb85-8c06-43e5-bb9e-64f66dcbded1 None None] MFA Rules not processed for user `c5c79bb549aa4e0e84a5cb600e22fbb7`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:05.481631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-256ceb85-8c06-43e5-bb9e-64f66dcbded1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:05.858314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b010090-0ca2-43c3-90aa-742a74d85196 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:05.858314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff54974-ec71-4555-a176-0c4991d4f594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:05.858314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff54974-ec71-4555-a176-0c4991d4f594 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.858314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff54974-ec71-4555-a176-0c4991d4f594 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.866128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff54974-ec71-4555-a176-0c4991d4f594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.866956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 833/1641] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:05.866956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ceb85-8c06-43e5-bb9e-64f66dcbded1 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:05.866956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ceb85-8c06-43e5-bb9e-64f66dcbded1 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:05.866956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e50ca4-4cc0-4027-81c6-d417f7d4cc77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:05.867847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e50ca4-4cc0-4027-81c6-d417f7d4cc77 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.867847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e50ca4-4cc0-4027-81c6-d417f7d4cc77 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.867847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e50ca4-4cc0-4027-81c6-d417f7d4cc77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.868365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff54974-ec71-4555-a176-0c4991d4f594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:05.868365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff54974-ec71-4555-a176-0c4991d4f594 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:05.868694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e50ca4-4cc0-4027-81c6-d417f7d4cc77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:05.868694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e50ca4-4cc0-4027-81c6-d417f7d4cc77 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:05.868892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 809/1642] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:05.869044 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 834/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:05.869654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b346fb-4c46-4c0d-9af8-399ff08cf224 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.869654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b346fb-4c46-4c0d-9af8-399ff08cf224 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.869654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b346fb-4c46-4c0d-9af8-399ff08cf224 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.869654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 810/1644] 10.222.0.42 () {54 vars in 912 bytes} [Fri May 27 14:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:01:05.870059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6ae7-06fc-4523-af22-15a02ef8f911 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:05.870059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6ae7-06fc-4523-af22-15a02ef8f911 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:05.870059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d6ae7-06fc-4523-af22-15a02ef8f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:05.870059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-db0d6ae7-06fc-4523-af22-15a02ef8f911 None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:05.870059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-db0d6ae7-06fc-4523-af22-15a02ef8f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:05.916313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 835/1645] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:05.929049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b346fb-4c46-4c0d-9af8-399ff08cf224 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:05.930814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-27b346fb-4c46-4c0d-9af8-399ff08cf224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:06.001003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b346fb-4c46-4c0d-9af8-399ff08cf224 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:06.001003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46664f-8414-43c3-9704-05c0cb8ea42e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb36541c7ba418a843e5ecbb1f1e337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:06.001003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46664f-8414-43c3-9704-05c0cb8ea42e service glance] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:06.001003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46664f-8414-43c3-9704-05c0cb8ea42e service glance] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:06.001330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46664f-8414-43c3-9704-05c0cb8ea42e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:06.008714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46664f-8414-43c3-9704-05c0cb8ea42e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:06.010181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46664f-8414-43c3-9704-05c0cb8ea42e service glance] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:06.020837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 811/1646] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:06.153641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6ae7-06fc-4523-af22-15a02ef8f911 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:06.164017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d6ae7-06fc-4523-af22-15a02ef8f911 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:06.168724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dd7a7-e66e-40e3-8fa8-2b1fb83f3cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:06.174230 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd7a7-e66e-40e3-8fa8-2b1fb83f3cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:06.174230 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd7a7-e66e-40e3-8fa8-2b1fb83f3cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:06.174230 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd7a7-e66e-40e3-8fa8-2b1fb83f3cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:06.249478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd7a7-e66e-40e3-8fa8-2b1fb83f3cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:06.249478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd7a7-e66e-40e3-8fa8-2b1fb83f3cd0 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:06.284323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 836/1647] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:06.322724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:06.373309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe0a72-9e7c-4aa9-9096-d315f5b9eba4 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:06.373690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe0a72-9e7c-4aa9-9096-d315f5b9eba4 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:06.374039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe0a72-9e7c-4aa9-9096-d315f5b9eba4 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:06.375650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 812/1648] 10.222.0.42 () {54 vars in 912 bytes} [Fri May 27 14:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:01:06.381397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9dc59-292e-4029-9979-af607cde02ab None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:06.381683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9dc59-292e-4029-9979-af607cde02ab None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:06.381958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9dc59-292e-4029-9979-af607cde02ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:06.438225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-c0e9dc59-292e-4029-9979-af607cde02ab None None] MFA Rules not processed for user `7afc19dc502f425faf693eb963fe63d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:06.439606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c0e9dc59-292e-4029-9979-af607cde02ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:06.543632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 837/1649] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:01:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:06.554838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:06.608262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe0a72-9e7c-4aa9-9096-d315f5b9eba4 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:06.621829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe0a72-9e7c-4aa9-9096-d315f5b9eba4 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:06.628321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe909072-6bf6-4e14-b86b-e4b4c506cc64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:06.629109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe909072-6bf6-4e14-b86b-e4b4c506cc64 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:06.629633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe909072-6bf6-4e14-b86b-e4b4c506cc64 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:06.630070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe909072-6bf6-4e14-b86b-e4b4c506cc64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:06.641948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe909072-6bf6-4e14-b86b-e4b4c506cc64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:06.644744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe909072-6bf6-4e14-b86b-e4b4c506cc64 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:06.664204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 813/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:07.923124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:07.983853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd93fdd-200f-4102-88bb-94abace2c9a4 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:07.983853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd93fdd-200f-4102-88bb-94abace2c9a4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:07.983853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd93fdd-200f-4102-88bb-94abace2c9a4 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:07.983853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 838/1651] 10.222.0.42 () {54 vars in 960 bytes} [Fri May 27 14:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:01:08.006182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4320ba-42c1-4360-84d8-ddcfc2bbefa5 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:08.006687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4320ba-42c1-4360-84d8-ddcfc2bbefa5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:08.006901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4320ba-42c1-4360-84d8-ddcfc2bbefa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:08.042715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fd4320ba-42c1-4360-84d8-ddcfc2bbefa5 None None] MFA Rules not processed for user `b6375aed65de46e19a9d3da583b42bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:08.046372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fd4320ba-42c1-4360-84d8-ddcfc2bbefa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:08.126072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:08.220964 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 814/1652] 10.222.0.42 () {58 vars in 1057 bytes} [Fri May 27 14:01:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:08.224323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd93fdd-200f-4102-88bb-94abace2c9a4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:08.249919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd93fdd-200f-4102-88bb-94abace2c9a4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:08.260580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0b049-e360-4280-8d3f-157ae15d845c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:08.263083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0b049-e360-4280-8d3f-157ae15d845c service placement] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:08.263083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0b049-e360-4280-8d3f-157ae15d845c service placement] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:08.263083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0b049-e360-4280-8d3f-157ae15d845c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:08.264439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-46f0b049-e360-4280-8d3f-157ae15d845c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:08.277962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0b049-e360-4280-8d3f-157ae15d845c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:08.279620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0b049-e360-4280-8d3f-157ae15d845c service placement] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:08.314242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 839/1653] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:11.870575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4320ba-42c1-4360-84d8-ddcfc2bbefa5 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:12.017250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4320ba-42c1-4360-84d8-ddcfc2bbefa5 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:12.035104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:12.036113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:12.039628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:12.040259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] PATH_INFO: `/v3/users/4bb3ef10b30d4609a6ffe3ce28ea8f6c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:12.043894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb3ef10b30d4609a6ffe3ce28ea8f6c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:12.046022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:12.342901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0b049-e360-4280-8d3f-157ae15d845c service placement] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:12.374101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0b049-e360-4280-8d3f-157ae15d845c service placement] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:12.392268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:12.393575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:12.396159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:12.396615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] PATH_INFO: `/v3/users/5ce1cc68c4164d7fa09506b25c959374` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:12.398722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce1cc68c4164d7fa09506b25c959374)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:12.403500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: WARNING py.warnings [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 14:01:12.403500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: warnings.warn(msg) May 27 14:01:12.403500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: May 27 14:01:12.408237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:12.411633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb3ef10b30d4609a6ffe3ce28ea8f6c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:12.413425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb3ef10b30d4609a6ffe3ce28ea8f6c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:12.417002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb3ef10b30d4609a6ffe3ce28ea8f6c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:12.435674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb3ef10b30d4609a6ffe3ce28ea8f6c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:12.469226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0f68a520-17b4-4db3-8924-2e4829c05f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb3ef10b30d4609a6ffe3ce28ea8f6c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:12.562890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 815/1654] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:11 2022] DELETE /identity/v3/users/4bb3ef10b30d4609a6ffe3ce28ea8f6c => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:12.563468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc480d-bc31-4d5a-b136-deeb61c83cf5 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:12.563767 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc480d-bc31-4d5a-b136-deeb61c83cf5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:12.564732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc480d-bc31-4d5a-b136-deeb61c83cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:12.605606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-5ccc480d-bc31-4d5a-b136-deeb61c83cf5 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:12.607179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5ccc480d-bc31-4d5a-b136-deeb61c83cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:12.715535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:12.752901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 816/1655] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:12.789462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc480d-bc31-4d5a-b136-deeb61c83cf5 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:12.793372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5ccc480d-bc31-4d5a-b136-deeb61c83cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:12.800736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce1cc68c4164d7fa09506b25c959374'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:12.802102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce1cc68c4164d7fa09506b25c959374'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:12.803603 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce1cc68c4164d7fa09506b25c959374'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:12.932809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc480d-bc31-4d5a-b136-deeb61c83cf5 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:12.933842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce1cc68c4164d7fa09506b25c959374'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:12.937095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420607b-57b5-4964-91d7-80c374393936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:12.937814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420607b-57b5-4964-91d7-80c374393936 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:12.938097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420607b-57b5-4964-91d7-80c374393936 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:12.938376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420607b-57b5-4964-91d7-80c374393936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:12.940309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3420607b-57b5-4964-91d7-80c374393936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:12.955516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420607b-57b5-4964-91d7-80c374393936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:12.956229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce1cc68c4164d7fa09506b25c959374'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:12.957512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420607b-57b5-4964-91d7-80c374393936 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:12.974944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 817/1656] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:13.041776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 840/1657] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:12 2022] DELETE /identity/v3/users/5ce1cc68c4164d7fa09506b25c959374 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:13.043652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab28d-38ae-469b-9570-263a233d3482 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:13.043927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab28d-38ae-469b-9570-263a233d3482 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:13.044560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab28d-38ae-469b-9570-263a233d3482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:13.091431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-6baab28d-38ae-469b-9570-263a233d3482 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:13.092677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-6baab28d-38ae-469b-9570-263a233d3482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:13.244422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 818/1658] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:13.264992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:13.266446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:13.397213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9d554-5f6e-494d-b743-54909a551d45 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:13.402762 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa58344-2e55-4420-84ad-e4951988e6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:13.403684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58344-2e55-4420-84ad-e4951988e6af service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:13.404121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58344-2e55-4420-84ad-e4951988e6af service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:13.404542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa58344-2e55-4420-84ad-e4951988e6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:13.419119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa58344-2e55-4420-84ad-e4951988e6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:13.421037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa58344-2e55-4420-84ad-e4951988e6af service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:13.434093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 841/1659] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:14.484897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baab28d-38ae-469b-9570-263a233d3482 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:14.486770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-6baab28d-38ae-469b-9570-263a233d3482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:14.511725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baab28d-38ae-469b-9570-263a233d3482 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:14.528366 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:14.529514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:14.529944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:14.530362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] PATH_INFO: `/v3/projects/5823c2eec14543e5a2d640fba1fa2276` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:14.533571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5823c2eec14543e5a2d640fba1fa2276)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:14.537826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: WARNING py.warnings [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 14:01:14.537826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: warnings.warn(msg) May 27 14:01:14.537826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: May 27 14:01:14.539451 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:14.839773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5823c2eec14543e5a2d640fba1fa2276', 'request_id': 'req-3910e232-009c-4eba-b94c-3933ead89f4d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:14.854144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5823c2eec14543e5a2d640fba1fa2276', 'request_id': 'req-3910e232-009c-4eba-b94c-3933ead89f4d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:14.908751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5823c2eec14543e5a2d640fba1fa2276', 'request_id': 'req-3910e232-009c-4eba-b94c-3933ead89f4d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:15.003419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] The token cache is being invalidate because project 5823c2eec14543e5a2d640fba1fa2276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:15.003795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:15.004643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3910e232-009c-4eba-b94c-3933ead89f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:15.008221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 819/1660] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:14 2022] DELETE /identity/v3/projects/5823c2eec14543e5a2d640fba1fa2276 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:15.013816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca7598-3aa2-48e4-848e-314b307a796d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:15.014658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca7598-3aa2-48e4-848e-314b307a796d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:15.015219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca7598-3aa2-48e4-848e-314b307a796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:15.048033 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f3ca7598-3aa2-48e4-848e-314b307a796d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:15.049754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f3ca7598-3aa2-48e4-848e-314b307a796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:15.221820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:15.237712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 842/1661] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:15.245538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804ecc-e8e8-40ca-9953-5183074d5023 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:15.245932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804ecc-e8e8-40ca-9953-5183074d5023 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:15.246134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804ecc-e8e8-40ca-9953-5183074d5023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:15.297211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-78804ecc-e8e8-40ca-9953-5183074d5023 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:15.304580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-78804ecc-e8e8-40ca-9953-5183074d5023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:15.338471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca7598-3aa2-48e4-848e-314b307a796d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:15.340870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f3ca7598-3aa2-48e4-848e-314b307a796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:15.348030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 820/1662] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:15.350731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804ecc-e8e8-40ca-9953-5183074d5023 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:15.366479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca7598-3aa2-48e4-848e-314b307a796d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:15.366665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:15.367495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:15.368353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:15.369329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:15.369644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] PATH_INFO: `/v3/projects/b300fa9b3cca466fade2c5cab0bf53db` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:15.371321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b300fa9b3cca466fade2c5cab0bf53db)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:15.373475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:15.401846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804ecc-e8e8-40ca-9953-5183074d5023 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:15.408747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aede9-2bc8-47d7-8409-e8d2c91fb129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:15.423955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aede9-2bc8-47d7-8409-e8d2c91fb129 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:15.423955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aede9-2bc8-47d7-8409-e8d2c91fb129 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:15.423955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22aede9-2bc8-47d7-8409-e8d2c91fb129 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:15.424650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22aede9-2bc8-47d7-8409-e8d2c91fb129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:15.425179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22aede9-2bc8-47d7-8409-e8d2c91fb129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:15.427258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22aede9-2bc8-47d7-8409-e8d2c91fb129 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:15.449246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 821/1663] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:15.450621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aede9-2bc8-47d7-8409-e8d2c91fb129 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:15.476306 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22aede9-2bc8-47d7-8409-e8d2c91fb129 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:15.494731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bdd5e-252e-45ee-bb73-f03bad3d35bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:15.497184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bdd5e-252e-45ee-bb73-f03bad3d35bf admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:15.497887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bdd5e-252e-45ee-bb73-f03bad3d35bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:15.498356 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bdd5e-252e-45ee-bb73-f03bad3d35bf admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:15.499795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bdd5e-252e-45ee-bb73-f03bad3d35bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:15.504401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bdd5e-252e-45ee-bb73-f03bad3d35bf admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:15.564501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b300fa9b3cca466fade2c5cab0bf53db', 'request_id': 'req-d7633a0f-bdbd-4582-9622-0280e9cc069e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:15.579253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b300fa9b3cca466fade2c5cab0bf53db', 'request_id': 'req-d7633a0f-bdbd-4582-9622-0280e9cc069e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:15.587184 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b300fa9b3cca466fade2c5cab0bf53db', 'request_id': 'req-d7633a0f-bdbd-4582-9622-0280e9cc069e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:15.616212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 822/1664] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:15 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:15.621626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bdd5e-252e-45ee-bb73-f03bad3d35bf admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:15.748288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] The token cache is being invalidate because project b300fa9b3cca466fade2c5cab0bf53db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:15.748288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:15.760597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:15.769870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 843/1665] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:15 2022] DELETE /identity/v3/projects/b300fa9b3cca466fade2c5cab0bf53db => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:15.771280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:15.785294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:15.813101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bdd5e-252e-45ee-bb73-f03bad3d35bf admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:15.834921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e861e45-ade5-4f0d-abfa-7c3ee7f32cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:15.835816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861e45-ade5-4f0d-abfa-7c3ee7f32cac admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:15.837404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861e45-ade5-4f0d-abfa-7c3ee7f32cac admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:15.838841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e861e45-ade5-4f0d-abfa-7c3ee7f32cac admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:15.843708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e861e45-ade5-4f0d-abfa-7c3ee7f32cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:15.843708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e861e45-ade5-4f0d-abfa-7c3ee7f32cac admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:15.971841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7633a0f-bdbd-4582-9622-0280e9cc069e admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:15.999020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:15.999020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:15.999020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:15.999020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] PATH_INFO: `/v3/users/df80f0ce5b304334a3ecdfd26d6cb75b` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:16.001603 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=df80f0ce5b304334a3ecdfd26d6cb75b)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:16.005900 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:16.055850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 823/1666] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:15 2022] POST /identity/v3/users => generated 303 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:16.060745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e861e45-ade5-4f0d-abfa-7c3ee7f32cac admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:16.064745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0e861e45-ade5-4f0d-abfa-7c3ee7f32cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:16.104501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e861e45-ade5-4f0d-abfa-7c3ee7f32cac admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:16.116999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165175e0-874f-49c9-af7e-99cfcb6ba71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:16.117695 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165175e0-874f-49c9-af7e-99cfcb6ba71f admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:16.117982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165175e0-874f-49c9-af7e-99cfcb6ba71f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:16.118261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165175e0-874f-49c9-af7e-99cfcb6ba71f admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:16.119681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165175e0-874f-49c9-af7e-99cfcb6ba71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:16.121391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165175e0-874f-49c9-af7e-99cfcb6ba71f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:16.146943 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 824/1667] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:16.152330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165175e0-874f-49c9-af7e-99cfcb6ba71f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:16.170763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165175e0-874f-49c9-af7e-99cfcb6ba71f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:16.187327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df2c69-9def-4c76-97e5-fe65474abeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:16.188005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df2c69-9def-4c76-97e5-fe65474abeec admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:16.188285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df2c69-9def-4c76-97e5-fe65474abeec admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:16.188558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df2c69-9def-4c76-97e5-fe65474abeec admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:16.190202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df2c69-9def-4c76-97e5-fe65474abeec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:16.191720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df2c69-9def-4c76-97e5-fe65474abeec admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:16.219403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 825/1668] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:16.220972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df2c69-9def-4c76-97e5-fe65474abeec admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:16.255849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df2c69-9def-4c76-97e5-fe65474abeec admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:16.269448 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb891f-ee66-4e8f-861a-9303f8884189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:16.271045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb891f-ee66-4e8f-861a-9303f8884189 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:16.271532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb891f-ee66-4e8f-861a-9303f8884189 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:16.272123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb891f-ee66-4e8f-861a-9303f8884189 admin admin] PATH_INFO: `/v3/projects/30b2fed23ef4484f87aae921d4e3e5a9/users/b40d8caa1abb4ee58f679d5adfa1d022/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:16.297541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb891f-ee66-4e8f-861a-9303f8884189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b2fed23ef4484f87aae921d4e3e5a9, user_id=b40d8caa1abb4ee58f679d5adfa1d022, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:16.298771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb891f-ee66-4e8f-861a-9303f8884189 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:16.360397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df80f0ce5b304334a3ecdfd26d6cb75b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:16.360397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df80f0ce5b304334a3ecdfd26d6cb75b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:16.363598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df80f0ce5b304334a3ecdfd26d6cb75b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:16.389706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 826/1669] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:16 2022] PUT /identity/v3/projects/30b2fed23ef4484f87aae921d4e3e5a9/users/b40d8caa1abb4ee58f679d5adfa1d022/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:16.403958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34da1-20d4-4344-af1e-761871257706 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:16.404256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34da1-20d4-4344-af1e-761871257706 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:16.404597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34da1-20d4-4344-af1e-761871257706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:16.482478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df80f0ce5b304334a3ecdfd26d6cb75b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:16.493893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f4e7f75-bae4-4009-a00e-4eb46711cebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df80f0ce5b304334a3ecdfd26d6cb75b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:16.536067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 844/1670] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:15 2022] DELETE /identity/v3/users/df80f0ce5b304334a3ecdfd26d6cb75b => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:16.570835 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-71c34da1-20d4-4344-af1e-761871257706 None None] MFA Rules not processed for user `b40d8caa1abb4ee58f679d5adfa1d022`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:16.573310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-71c34da1-20d4-4344-af1e-761871257706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:16.913062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7367-8e59-4000-af8c-ba3ca0f5522c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:16.913358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7367-8e59-4000-af8c-ba3ca0f5522c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:16.913641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7367-8e59-4000-af8c-ba3ca0f5522c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:17.028596 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3b5d7367-8e59-4000-af8c-ba3ca0f5522c None None] MFA Rules not processed for user `2e7ba82a80834a4aa098e9604165cfad`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:17.030511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3b5d7367-8e59-4000-af8c-ba3ca0f5522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:17.185838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 827/1671] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 784 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:17.190860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34da1-20d4-4344-af1e-761871257706 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:17.192361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-71c34da1-20d4-4344-af1e-761871257706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:17.246678 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 845/1672] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:17.257100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d7367-8e59-4000-af8c-ba3ca0f5522c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:17.258679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3b5d7367-8e59-4000-af8c-ba3ca0f5522c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:17.334852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34da1-20d4-4344-af1e-761871257706 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:17.363043 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:17.380198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c92d-4d6e-4c29-add6-708263102c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:17.380889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c92d-4d6e-4c29-add6-708263102c4e admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:17.381172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c92d-4d6e-4c29-add6-708263102c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:17.385973 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c92d-4d6e-4c29-add6-708263102c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:17.387031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c92d-4d6e-4c29-add6-708263102c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:17.389191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c92d-4d6e-4c29-add6-708263102c4e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:17.393123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:17.409204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d7367-8e59-4000-af8c-ba3ca0f5522c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:17.416155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69d06-b0e1-48c5-b38a-c5e479c6fdec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:17.417613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69d06-b0e1-48c5-b38a-c5e479c6fdec service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:17.418090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69d06-b0e1-48c5-b38a-c5e479c6fdec service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:17.418513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69d06-b0e1-48c5-b38a-c5e479c6fdec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:17.430043 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c69d06-b0e1-48c5-b38a-c5e479c6fdec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:17.431752 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c69d06-b0e1-48c5-b38a-c5e479c6fdec service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:17.442903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 846/1673] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:17.503258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69d06-b0e1-48c5-b38a-c5e479c6fdec service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:17.509385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 828/1674] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:17 2022] POST /identity/v3/projects => generated 403 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:17.519025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c69d06-b0e1-48c5-b38a-c5e479c6fdec service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:17.531716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1995-8542-4643-b0e4-280f5ac36099 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:17.532371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1995-8542-4643-b0e4-280f5ac36099 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:17.532841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670c1995-8542-4643-b0e4-280f5ac36099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:17.627454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-670c1995-8542-4643-b0e4-280f5ac36099 None None] MFA Rules not processed for user `f77a4ee31a9e48d18a3be08267eb6236`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:17.636575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-670c1995-8542-4643-b0e4-280f5ac36099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:17.753268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82840b8f-ba59-4c3a-8dd6-8304c904cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:17.753973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840b8f-ba59-4c3a-8dd6-8304c904cf64 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:17.754258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840b8f-ba59-4c3a-8dd6-8304c904cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:17.754531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840b8f-ba59-4c3a-8dd6-8304c904cf64 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:17.755498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82840b8f-ba59-4c3a-8dd6-8304c904cf64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:17.757827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82840b8f-ba59-4c3a-8dd6-8304c904cf64 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:17.869597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 829/1675] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:17.880154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1995-8542-4643-b0e4-280f5ac36099 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:17.881606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-670c1995-8542-4643-b0e4-280f5ac36099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:17.903209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 847/1676] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:17 2022] POST /identity/v3/users => generated 308 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:17.907154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82840b8f-ba59-4c3a-8dd6-8304c904cf64 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:17.932242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82840b8f-ba59-4c3a-8dd6-8304c904cf64 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:17.957662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec326442-98dc-4e36-95a5-9c5c03e6b648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:17.960441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326442-98dc-4e36-95a5-9c5c03e6b648 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:17.962827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326442-98dc-4e36-95a5-9c5c03e6b648 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:17.963406 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec326442-98dc-4e36-95a5-9c5c03e6b648 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:17.965779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec326442-98dc-4e36-95a5-9c5c03e6b648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:17.969703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec326442-98dc-4e36-95a5-9c5c03e6b648 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:18.000027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 848/1677] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:18.002426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec326442-98dc-4e36-95a5-9c5c03e6b648 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:18.027299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec326442-98dc-4e36-95a5-9c5c03e6b648 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:18.041542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af805e2-01e0-48c8-92bf-cc78658dad1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:18.043976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af805e2-01e0-48c8-92bf-cc78658dad1e admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:18.043976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af805e2-01e0-48c8-92bf-cc78658dad1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:18.043976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af805e2-01e0-48c8-92bf-cc78658dad1e admin admin] PATH_INFO: `/v3/projects/9a2808282d254409ae586637bd52ee15/users/eb82451c5cb04056a0b7728cb8e8384c/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:18.079739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af805e2-01e0-48c8-92bf-cc78658dad1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2808282d254409ae586637bd52ee15, user_id=eb82451c5cb04056a0b7728cb8e8384c, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:18.084103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af805e2-01e0-48c8-92bf-cc78658dad1e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:18.100970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670c1995-8542-4643-b0e4-280f5ac36099 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:18.109795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208561c-99ac-4594-9860-775e84a210dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:18.110590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208561c-99ac-4594-9860-775e84a210dd service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:18.111041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208561c-99ac-4594-9860-775e84a210dd service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:18.115255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208561c-99ac-4594-9860-775e84a210dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:18.129686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208561c-99ac-4594-9860-775e84a210dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:18.131553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208561c-99ac-4594-9860-775e84a210dd service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:18.142352 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 830/1678] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:18.190529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 849/1679] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:18 2022] PUT /identity/v3/projects/9a2808282d254409ae586637bd52ee15/users/eb82451c5cb04056a0b7728cb8e8384c/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:18.194605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208561c-99ac-4594-9860-775e84a210dd service nova] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:18.209064 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208561c-99ac-4594-9860-775e84a210dd service nova] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:18.265259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af805e2-01e0-48c8-92bf-cc78658dad1e admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:18.269036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-2af805e2-01e0-48c8-92bf-cc78658dad1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:18.331515 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c5d2c-39b2-466f-8422-78676b482eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:18.332377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c5d2c-39b2-466f-8422-78676b482eaf admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:18.332801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c5d2c-39b2-466f-8422-78676b482eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:18.333114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c5d2c-39b2-466f-8422-78676b482eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:18.333855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c5d2c-39b2-466f-8422-78676b482eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:18.336419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c5d2c-39b2-466f-8422-78676b482eaf admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:18.372795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 831/1680] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:18.373919 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c5d2c-39b2-466f-8422-78676b482eaf admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:18.387558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c5d2c-39b2-466f-8422-78676b482eaf admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:18.392933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af805e2-01e0-48c8-92bf-cc78658dad1e admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:18.394216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3554b6f-64e8-46ff-bc8a-02e2dfa714d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:18.395390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3554b6f-64e8-46ff-bc8a-02e2dfa714d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:18.400041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3554b6f-64e8-46ff-bc8a-02e2dfa714d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:18.400041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3554b6f-64e8-46ff-bc8a-02e2dfa714d5 admin admin] PATH_INFO: `/v3/projects/9a2808282d254409ae586637bd52ee15/users/eb82451c5cb04056a0b7728cb8e8384c/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:18.400041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3554b6f-64e8-46ff-bc8a-02e2dfa714d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2808282d254409ae586637bd52ee15, user_id=eb82451c5cb04056a0b7728cb8e8384c, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:18.402004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:18.402942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:18.403256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:18.403533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] PATH_INFO: `/v3/projects/084a90bcf16345fb821d7ede7b0280a7` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:18.404099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3554b6f-64e8-46ff-bc8a-02e2dfa714d5 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:18.404742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=084a90bcf16345fb821d7ede7b0280a7)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:18.406823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:18.438095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 832/1681] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:18 2022] PUT /identity/v3/projects/9a2808282d254409ae586637bd52ee15/users/eb82451c5cb04056a0b7728cb8e8384c/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:18.439698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda141-7dac-4428-8ac4-0a8fd03ff740 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:18.441391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda141-7dac-4428-8ac4-0a8fd03ff740 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:18.442718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bda141-7dac-4428-8ac4-0a8fd03ff740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:18.454429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:18.482378 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-b0bda141-7dac-4428-8ac4-0a8fd03ff740 None None] MFA Rules not processed for user `eb82451c5cb04056a0b7728cb8e8384c`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:18.483746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b0bda141-7dac-4428-8ac4-0a8fd03ff740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:18.551967 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084a90bcf16345fb821d7ede7b0280a7', 'request_id': 'req-72ab7db8-72a8-4019-8036-ce7261e26d11'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:18.583599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084a90bcf16345fb821d7ede7b0280a7', 'request_id': 'req-72ab7db8-72a8-4019-8036-ce7261e26d11'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:18.584427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 833/1682] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:18.595273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bda141-7dac-4428-8ac4-0a8fd03ff740 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:18.596830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b0bda141-7dac-4428-8ac4-0a8fd03ff740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:18.617318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084a90bcf16345fb821d7ede7b0280a7', 'request_id': 'req-72ab7db8-72a8-4019-8036-ce7261e26d11'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:18.697368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] The token cache is being invalidate because project 084a90bcf16345fb821d7ede7b0280a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:18.697368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:18.697629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-72ab7db8-72a8-4019-8036-ce7261e26d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:18.698350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bda141-7dac-4428-8ac4-0a8fd03ff740 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:18.700727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 850/1683] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:18 2022] DELETE /identity/v3/projects/084a90bcf16345fb821d7ede7b0280a7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:18.708278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921ca8-57e6-4c2a-9ed2-6a6c16f723b1 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:18.708621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921ca8-57e6-4c2a-9ed2-6a6c16f723b1 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:18.713305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921ca8-57e6-4c2a-9ed2-6a6c16f723b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:18.757913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8f921ca8-57e6-4c2a-9ed2-6a6c16f723b1 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:18.762299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8f921ca8-57e6-4c2a-9ed2-6a6c16f723b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:18.872716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ec441-285a-46ef-a686-649381620d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:18.873637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ec441-285a-46ef-a686-649381620d17 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:18.873892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ec441-285a-46ef-a686-649381620d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:18.874245 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ec441-285a-46ef-a686-649381620d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:18.876761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1a6ec441-285a-46ef-a686-649381620d17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:18.942407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 851/1684] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:18.942407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53e9fb-e405-4cee-8e80-8fa23bda0b10 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:18.942407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53e9fb-e405-4cee-8e80-8fa23bda0b10 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:18.942407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53e9fb-e405-4cee-8e80-8fa23bda0b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:18.971416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:18.977060 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-4b53e9fb-e405-4cee-8e80-8fa23bda0b10 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:18.977060 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4b53e9fb-e405-4cee-8e80-8fa23bda0b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:18.985178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 852/1685] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:18.990238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53e9fb-e405-4cee-8e80-8fa23bda0b10 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:18.997027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ec441-285a-46ef-a686-649381620d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:19.002563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ec441-285a-46ef-a686-649381620d17 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:19.016525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53e9fb-e405-4cee-8e80-8fa23bda0b10 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:19.023167 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 834/1686] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:18 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:19.028976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d297f4a-51ad-413a-a2c0-bfc2569cc29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:19.030823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297f4a-51ad-413a-a2c0-bfc2569cc29e admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:19.030823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297f4a-51ad-413a-a2c0-bfc2569cc29e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:19.030823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297f4a-51ad-413a-a2c0-bfc2569cc29e admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:19.031552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d297f4a-51ad-413a-a2c0-bfc2569cc29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:19.031934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d297f4a-51ad-413a-a2c0-bfc2569cc29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:19.033949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d297f4a-51ad-413a-a2c0-bfc2569cc29e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:19.051273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 853/1687] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:19.055292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ec441-285a-46ef-a686-649381620d17 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:19.067944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ec441-285a-46ef-a686-649381620d17 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:19.075170 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59df804-0d07-4fbc-ab4b-8da1ea432b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:19.076301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59df804-0d07-4fbc-ab4b-8da1ea432b98 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:19.076843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59df804-0d07-4fbc-ab4b-8da1ea432b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:19.077377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59df804-0d07-4fbc-ab4b-8da1ea432b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:19.078632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59df804-0d07-4fbc-ab4b-8da1ea432b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:19.084078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59df804-0d07-4fbc-ab4b-8da1ea432b98 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:19.201884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbd76b-9c61-4859-854d-d758bc821e7c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:19.202219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbd76b-9c61-4859-854d-d758bc821e7c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:19.202511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbd76b-9c61-4859-854d-d758bc821e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:19.241383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 835/1688] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:19 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:19.245454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59df804-0d07-4fbc-ab4b-8da1ea432b98 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:19.272941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d3dbd76b-9c61-4859-854d-d758bc821e7c None None] MFA Rules not processed for user `7caf8c01365b4918abf24203b7a14dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:19.279248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d3dbd76b-9c61-4859-854d-d758bc821e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:19.374433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59df804-0d07-4fbc-ab4b-8da1ea432b98 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:19.380610 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3713931-3bb1-4022-a3a3-f745e5899555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:19.382416 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3713931-3bb1-4022-a3a3-f745e5899555 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:19.382416 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3713931-3bb1-4022-a3a3-f745e5899555 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:19.382416 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3713931-3bb1-4022-a3a3-f745e5899555 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:19.383314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3713931-3bb1-4022-a3a3-f745e5899555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:19.387769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3713931-3bb1-4022-a3a3-f745e5899555 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:19.457056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 854/1689] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:19.466492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbd76b-9c61-4859-854d-d758bc821e7c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:19.468603 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d3dbd76b-9c61-4859-854d-d758bc821e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:19.499687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbd76b-9c61-4859-854d-d758bc821e7c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:19.513365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:19.514802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:19.515505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:19.516009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] PATH_INFO: `/v3/users/b40d8caa1abb4ee58f679d5adfa1d022` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:19.518078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40d8caa1abb4ee58f679d5adfa1d022)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:19.520298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:19.537867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 836/1690] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:19 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:19.538834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3713931-3bb1-4022-a3a3-f745e5899555 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:19.543200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b3713931-3bb1-4022-a3a3-f745e5899555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:19.707953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3713931-3bb1-4022-a3a3-f745e5899555 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:19.732565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587735a5-d2b3-44aa-9faf-5cbcacd546c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:19.733475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587735a5-d2b3-44aa-9faf-5cbcacd546c4 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:19.734240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587735a5-d2b3-44aa-9faf-5cbcacd546c4 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:19.734800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587735a5-d2b3-44aa-9faf-5cbcacd546c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:19.751901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587735a5-d2b3-44aa-9faf-5cbcacd546c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:19.754393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587735a5-d2b3-44aa-9faf-5cbcacd546c4 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:19.786937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 837/1691] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:19.788682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587735a5-d2b3-44aa-9faf-5cbcacd546c4 service nova] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:19.818201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587735a5-d2b3-44aa-9faf-5cbcacd546c4 service nova] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:19.833025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178b12f-652d-4a03-b139-98343a842683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:19.834813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b12f-652d-4a03-b139-98343a842683 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:19.846019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b12f-652d-4a03-b139-98343a842683 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:19.846019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b12f-652d-4a03-b139-98343a842683 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:19.846019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178b12f-652d-4a03-b139-98343a842683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:19.846578 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178b12f-652d-4a03-b139-98343a842683 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:19.865827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40d8caa1abb4ee58f679d5adfa1d022'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:19.869855 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40d8caa1abb4ee58f679d5adfa1d022'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:19.870745 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40d8caa1abb4ee58f679d5adfa1d022'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:19.871523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 838/1692] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:19.874406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b16c0-d10a-48d6-8ba9-e0af856608da None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:19.875560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b16c0-d10a-48d6-8ba9-e0af856608da None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:19.876028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b16c0-d10a-48d6-8ba9-e0af856608da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:19.920296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-e53b16c0-d10a-48d6-8ba9-e0af856608da None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:19.921728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e53b16c0-d10a-48d6-8ba9-e0af856608da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:19.946470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40d8caa1abb4ee58f679d5adfa1d022'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:19.969254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40d8caa1abb4ee58f679d5adfa1d022'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:19.975953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:20.051020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 855/1693] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:19 2022] DELETE /identity/v3/users/b40d8caa1abb4ee58f679d5adfa1d022 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:20.052073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:20.058656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:20.192194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 839/1694] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:20.199189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b379-34bb-4408-9436-574d77232dde None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:20.199189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b379-34bb-4408-9436-574d77232dde None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:20.199189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b379-34bb-4408-9436-574d77232dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:20.245517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-9f13b379-34bb-4408-9436-574d77232dde None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:20.247170 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9f13b379-34bb-4408-9436-574d77232dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:20.351689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66439c7-ac58-4980-a368-4dfc27d36600 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:20.361176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9874d-5d8f-441a-b544-fca0a5df6ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:20.361863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9874d-5d8f-441a-b544-fca0a5df6ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:20.377170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9874d-5d8f-441a-b544-fca0a5df6ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:20.377888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9874d-5d8f-441a-b544-fca0a5df6ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:20.380737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9874d-5d8f-441a-b544-fca0a5df6ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:20.388631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9874d-5d8f-441a-b544-fca0a5df6ee1 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:20.407005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 840/1695] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:20.419320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 856/1696] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:20.420553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13b379-34bb-4408-9436-574d77232dde None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:20.433326 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13b379-34bb-4408-9436-574d77232dde None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:20.446239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d1056-aa65-4349-b497-105cc5d5284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:20.446239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1056-aa65-4349-b497-105cc5d5284f admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:20.446239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1056-aa65-4349-b497-105cc5d5284f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:20.446239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d1056-aa65-4349-b497-105cc5d5284f admin admin] PATH_INFO: `/v3/projects/b9c06eaf29d5464bb534eedc7ef9c91a/users/27eb177c36394ebca2ff7e0f7e6ed63d/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:20.446747 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9874d-5d8f-441a-b544-fca0a5df6ee1 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:20.448387 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-34c9874d-5d8f-441a-b544-fca0a5df6ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:20.500976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d1056-aa65-4349-b497-105cc5d5284f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c06eaf29d5464bb534eedc7ef9c91a, user_id=27eb177c36394ebca2ff7e0f7e6ed63d, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:20.504401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d1056-aa65-4349-b497-105cc5d5284f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:20.572728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9874d-5d8f-441a-b544-fca0a5df6ee1 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:20.578059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2001780-f497-4037-9bad-ed1a48ffcbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:20.579084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2001780-f497-4037-9bad-ed1a48ffcbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:20.579712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2001780-f497-4037-9bad-ed1a48ffcbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:20.579923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2001780-f497-4037-9bad-ed1a48ffcbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:20.591953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2001780-f497-4037-9bad-ed1a48ffcbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:20.593953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2001780-f497-4037-9bad-ed1a48ffcbd1 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:20.613876 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 857/1697] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:20.745543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 841/1698] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:20 2022] PUT /identity/v3/projects/b9c06eaf29d5464bb534eedc7ef9c91a/users/27eb177c36394ebca2ff7e0f7e6ed63d/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:20.754590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67508b-0739-4980-9cf6-bfbb84171834 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:20.755832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d1056-aa65-4349-b497-105cc5d5284f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:20.757392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67508b-0739-4980-9cf6-bfbb84171834 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:20.758447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b67d1056-aa65-4349-b497-105cc5d5284f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:20.761982 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67508b-0739-4980-9cf6-bfbb84171834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:20.849627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:20.883737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3b67508b-0739-4980-9cf6-bfbb84171834 None None] MFA Rules not processed for user `27eb177c36394ebca2ff7e0f7e6ed63d`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:20.886662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3b67508b-0739-4980-9cf6-bfbb84171834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:21.043550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d1056-aa65-4349-b497-105cc5d5284f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:21.048506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 858/1699] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:21.053259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67508b-0739-4980-9cf6-bfbb84171834 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:21.063322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff90468-466f-4483-acf4-f3ad9dc24f0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:21.064202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff90468-466f-4483-acf4-f3ad9dc24f0d service swift] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:21.064350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff90468-466f-4483-acf4-f3ad9dc24f0d service swift] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:21.065751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff90468-466f-4483-acf4-f3ad9dc24f0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:21.238650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff90468-466f-4483-acf4-f3ad9dc24f0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:21.244850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67508b-0739-4980-9cf6-bfbb84171834 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:21.247454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff90468-466f-4483-acf4-f3ad9dc24f0d service swift] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:21.270878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fa9ea-81dd-468e-a5e9-408f4cbf578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:21.276198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fa9ea-81dd-468e-a5e9-408f4cbf578d admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:21.276615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fa9ea-81dd-468e-a5e9-408f4cbf578d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:21.285845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fa9ea-81dd-468e-a5e9-408f4cbf578d admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:21.287991 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fa9ea-81dd-468e-a5e9-408f4cbf578d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:21.288799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 842/1700] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:01:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:01:21.291336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fa9ea-81dd-468e-a5e9-408f4cbf578d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:21.450223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 859/1701] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:21 2022] POST /identity/v3/projects => generated 387 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:21.454665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff90468-466f-4483-acf4-f3ad9dc24f0d service swift] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:21.480873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff90468-466f-4483-acf4-f3ad9dc24f0d service swift] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:21.799394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc1b42-538d-4b6e-96c9-b2736fc22baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:21.801908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc1b42-538d-4b6e-96c9-b2736fc22baf admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:21.802726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc1b42-538d-4b6e-96c9-b2736fc22baf admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:21.804032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc1b42-538d-4b6e-96c9-b2736fc22baf admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:21.805076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc1b42-538d-4b6e-96c9-b2736fc22baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:21.815480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc1b42-538d-4b6e-96c9-b2736fc22baf admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:22.040094 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fa9ea-81dd-468e-a5e9-408f4cbf578d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:22.043537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 843/1702] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:21 2022] POST /identity/v3/users => generated 300 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:22.057770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fa9ea-81dd-468e-a5e9-408f4cbf578d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:22.067698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c9544-2981-4a26-93e8-acccfc0229e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:22.070199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9544-2981-4a26-93e8-acccfc0229e6 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:22.070199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9544-2981-4a26-93e8-acccfc0229e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:22.070199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c9544-2981-4a26-93e8-acccfc0229e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:22.071217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9544-2981-4a26-93e8-acccfc0229e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:22.074901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c9544-2981-4a26-93e8-acccfc0229e6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:22.098750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc1b42-538d-4b6e-96c9-b2736fc22baf admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:22.107600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 860/1703] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:22.116763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e9f23-13f8-4de0-b8fb-81e00695ea4b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:22.117968 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e9f23-13f8-4de0-b8fb-81e00695ea4b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:22.118287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e9f23-13f8-4de0-b8fb-81e00695ea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:22.121197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc1b42-538d-4b6e-96c9-b2736fc22baf admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:22.144855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d771-ca6e-4fa2-93c1-8615431c8a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:22.146031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d771-ca6e-4fa2-93c1-8615431c8a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:22.146156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d771-ca6e-4fa2-93c1-8615431c8a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:22.150923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853d771-ca6e-4fa2-93c1-8615431c8a00 admin admin] PATH_INFO: `/v3/projects/4a09379acf024dd8a51fbfdcf499cf66/users/f1ad02d1f5c24d72948b15fc5ee1c7cd/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:22.192267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-9a7e9f23-13f8-4de0-b8fb-81e00695ea4b None None] MFA Rules not processed for user `7afc19dc502f425faf693eb963fe63d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:22.196100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9a7e9f23-13f8-4de0-b8fb-81e00695ea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:22.204627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d771-ca6e-4fa2-93c1-8615431c8a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a09379acf024dd8a51fbfdcf499cf66, user_id=f1ad02d1f5c24d72948b15fc5ee1c7cd, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:22.214378 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853d771-ca6e-4fa2-93c1-8615431c8a00 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:22.319995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:22.338688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 844/1704] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:22 2022] PUT /identity/v3/projects/4a09379acf024dd8a51fbfdcf499cf66/users/f1ad02d1f5c24d72948b15fc5ee1c7cd/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:22.340050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d771-ca6e-4fa2-93c1-8615431c8a00 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:22.349877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2853d771-ca6e-4fa2-93c1-8615431c8a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:22.432535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 861/1705] 10.222.0.64 () {58 vars in 1015 bytes} [Fri May 27 14:01:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:22.433697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e9f23-13f8-4de0-b8fb-81e00695ea4b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:22.486552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e9f23-13f8-4de0-b8fb-81e00695ea4b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:22.601638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853d771-ca6e-4fa2-93c1-8615431c8a00 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:22.625852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15685a43-c7f8-496b-8fbc-54c61f138552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:22.626872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15685a43-c7f8-496b-8fbc-54c61f138552 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:22.627339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15685a43-c7f8-496b-8fbc-54c61f138552 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:22.627727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15685a43-c7f8-496b-8fbc-54c61f138552 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:22.628606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15685a43-c7f8-496b-8fbc-54c61f138552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:22.630734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15685a43-c7f8-496b-8fbc-54c61f138552 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:22.632474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:22.637399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:22.637695 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:22.637982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] PATH_INFO: `/v3/projects/30b2fed23ef4484f87aae921d4e3e5a9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:22.651885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b2fed23ef4484f87aae921d4e3e5a9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:22.657044 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:22.659851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 862/1706] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:22.661037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15685a43-c7f8-496b-8fbc-54c61f138552 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:22.847327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15685a43-c7f8-496b-8fbc-54c61f138552 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:22.888961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f393d3-6dbb-4803-975e-8d48eed21a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:22.889881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f393d3-6dbb-4803-975e-8d48eed21a6a service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:22.893088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f393d3-6dbb-4803-975e-8d48eed21a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:22.893606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f393d3-6dbb-4803-975e-8d48eed21a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:22.956041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f393d3-6dbb-4803-975e-8d48eed21a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:22.965368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f393d3-6dbb-4803-975e-8d48eed21a6a service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:22.965704 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b2fed23ef4484f87aae921d4e3e5a9', 'request_id': 'req-83559157-1dcd-4f8b-ba16-ab765d9fd089'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.000027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b2fed23ef4484f87aae921d4e3e5a9', 'request_id': 'req-83559157-1dcd-4f8b-ba16-ab765d9fd089'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.008916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 863/1707] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:23.012555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f393d3-6dbb-4803-975e-8d48eed21a6a service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:23.029484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b2fed23ef4484f87aae921d4e3e5a9', 'request_id': 'req-83559157-1dcd-4f8b-ba16-ab765d9fd089'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.065793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f393d3-6dbb-4803-975e-8d48eed21a6a service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:23.150750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] The token cache is being invalidate because project 30b2fed23ef4484f87aae921d4e3e5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:23.154620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.154620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.154987 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 845/1708] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:22 2022] DELETE /identity/v3/projects/30b2fed23ef4484f87aae921d4e3e5a9 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:23.159124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:23.163050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:23.222042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791b3f7-da4b-4a8f-818c-fabf35bf1011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:23.223073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791b3f7-da4b-4a8f-818c-fabf35bf1011 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:23.223362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791b3f7-da4b-4a8f-818c-fabf35bf1011 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:23.223643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791b3f7-da4b-4a8f-818c-fabf35bf1011 admin admin] PATH_INFO: `/v3/projects/4a09379acf024dd8a51fbfdcf499cf66/users/f1ad02d1f5c24d72948b15fc5ee1c7cd/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:23.226960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791b3f7-da4b-4a8f-818c-fabf35bf1011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a09379acf024dd8a51fbfdcf499cf66, user_id=f1ad02d1f5c24d72948b15fc5ee1c7cd, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:23.233966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791b3f7-da4b-4a8f-818c-fabf35bf1011 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:23.322324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 864/1709] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:23 2022] PUT /identity/v3/projects/4a09379acf024dd8a51fbfdcf499cf66/users/f1ad02d1f5c24d72948b15fc5ee1c7cd/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:23.323641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791b3f7-da4b-4a8f-818c-fabf35bf1011 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:23.327480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c791b3f7-da4b-4a8f-818c-fabf35bf1011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:23.405180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83559157-1dcd-4f8b-ba16-ab765d9fd089 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:23.547816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791b3f7-da4b-4a8f-818c-fabf35bf1011 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:23.563044 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:23.563947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:23.567355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:23.567653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] PATH_INFO: `/v3/users/eb82451c5cb04056a0b7728cb8e8384c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:23.571257 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb82451c5cb04056a0b7728cb8e8384c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:23.579010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:23.580401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:23.580906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:23.581400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:23.581598 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] PATH_INFO: `/v3/users/570453a990b2423eb319921f13054791` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:23.583723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] RBAC: Authorizing `identity:delete_user(user_id=570453a990b2423eb319921f13054791)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:23.585976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:23.905296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:23.944274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb82451c5cb04056a0b7728cb8e8384c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.945354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb82451c5cb04056a0b7728cb8e8384c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.946471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb82451c5cb04056a0b7728cb8e8384c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.987283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570453a990b2423eb319921f13054791'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.987283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570453a990b2423eb319921f13054791'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.987283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570453a990b2423eb319921f13054791'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:23.987283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570453a990b2423eb319921f13054791'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:24.014560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5b15327d-3533-4d70-bda3-54c5fc1d266d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570453a990b2423eb319921f13054791'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:24.044299 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:24.111281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb82451c5cb04056a0b7728cb8e8384c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:24.123835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6d408b6c-fc9b-4702-b4cf-7b9bc00a3890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb82451c5cb04056a0b7728cb8e8384c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:24.174120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 865/1710] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:23 2022] DELETE /identity/v3/users/eb82451c5cb04056a0b7728cb8e8384c => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:24.177837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddded31-22eb-47a5-a91e-86ebbc5932fa None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:24.178727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddded31-22eb-47a5-a91e-86ebbc5932fa None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:24.179250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddded31-22eb-47a5-a91e-86ebbc5932fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:24.231094 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-cddded31-22eb-47a5-a91e-86ebbc5932fa None None] MFA Rules not processed for user `f1ad02d1f5c24d72948b15fc5ee1c7cd`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:24.235038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cddded31-22eb-47a5-a91e-86ebbc5932fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:24.273052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 846/1711] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:23 2022] DELETE /identity/v3/users/570453a990b2423eb319921f13054791 => generated 0 bytes in 1117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:24.279259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117dd61-2d6b-44d4-b14f-652b8d2a8165 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:24.279963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117dd61-2d6b-44d4-b14f-652b8d2a8165 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:24.280404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117dd61-2d6b-44d4-b14f-652b8d2a8165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:24.363946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-0117dd61-2d6b-44d4-b14f-652b8d2a8165 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:24.379729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0117dd61-2d6b-44d4-b14f-652b8d2a8165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:24.480886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 866/1712] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:24.505984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddded31-22eb-47a5-a91e-86ebbc5932fa None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:24.508584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cddded31-22eb-47a5-a91e-86ebbc5932fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:24.697336 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 847/1713] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:24.745064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddded31-22eb-47a5-a91e-86ebbc5932fa None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:24.751458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117dd61-2d6b-44d4-b14f-652b8d2a8165 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:24.753677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0117dd61-2d6b-44d4-b14f-652b8d2a8165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:24.973384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117dd61-2d6b-44d4-b14f-652b8d2a8165 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:24.994858 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae1a0c-dea6-453d-8fbb-065bb2c33a6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:24.995734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae1a0c-dea6-453d-8fbb-065bb2c33a6f service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:24.996130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae1a0c-dea6-453d-8fbb-065bb2c33a6f service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:24.996514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae1a0c-dea6-453d-8fbb-065bb2c33a6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:25.012731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc623869-c57c-4f13-907a-c7394066edba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:25.014958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc623869-c57c-4f13-907a-c7394066edba service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:25.015472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc623869-c57c-4f13-907a-c7394066edba service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:25.016577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc623869-c57c-4f13-907a-c7394066edba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:25.068591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc623869-c57c-4f13-907a-c7394066edba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:25.068591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc623869-c57c-4f13-907a-c7394066edba service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:25.124048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 848/1714] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:25.276410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae1a0c-dea6-453d-8fbb-065bb2c33a6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:25.285876 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae1a0c-dea6-453d-8fbb-065bb2c33a6f service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:25.300291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 867/1715] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:25.630468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:25.680658 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc623869-c57c-4f13-907a-c7394066edba service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:25.683848 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-dc623869-c57c-4f13-907a-c7394066edba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:25.723916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc623869-c57c-4f13-907a-c7394066edba service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:25.742312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:25.743253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:25.743612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:25.743888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] PATH_INFO: `/v3/users/d89848987ecc4caa91ea69731b947ffd` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:25.746198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89848987ecc4caa91ea69731b947ffd)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:25.750616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:26.056942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89848987ecc4caa91ea69731b947ffd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:26.062286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89848987ecc4caa91ea69731b947ffd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:26.065106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89848987ecc4caa91ea69731b947ffd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:26.088456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89848987ecc4caa91ea69731b947ffd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:26.125642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c278394f-920f-4909-9385-2ebb333da8b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89848987ecc4caa91ea69731b947ffd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:26.335976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:26.349122 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 849/1716] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:25 2022] DELETE /identity/v3/users/d89848987ecc4caa91ea69731b947ffd => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:26.351048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b2eb-0f1b-404d-8856-be1f7b24d100 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:26.351413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b2eb-0f1b-404d-8856-be1f7b24d100 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:26.351778 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b2eb-0f1b-404d-8856-be1f7b24d100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:26.426355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f4e0b2eb-0f1b-404d-8856-be1f7b24d100 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:26.426355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f4e0b2eb-0f1b-404d-8856-be1f7b24d100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:26.644682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad295389-ba4b-4541-bb47-e3879781b986 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:26.645008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad295389-ba4b-4541-bb47-e3879781b986 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:26.645292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad295389-ba4b-4541-bb47-e3879781b986 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:26.647310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 850/1717] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:01:26.667137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 868/1718] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:26.679100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0dcbf-67a1-4b81-ac8a-d1f4ed9deee1 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:26.679673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0dcbf-67a1-4b81-ac8a-d1f4ed9deee1 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:26.680456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0dcbf-67a1-4b81-ac8a-d1f4ed9deee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:26.720888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4fe0dcbf-67a1-4b81-ac8a-d1f4ed9deee1 None None] MFA Rules not processed for user `2e7ba82a80834a4aa098e9604165cfad`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:26.722473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4fe0dcbf-67a1-4b81-ac8a-d1f4ed9deee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:26.823005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 851/1719] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:26.836116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab8d38-d50e-4fb7-adb1-d13c1d3bd93b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:26.836712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab8d38-d50e-4fb7-adb1-d13c1d3bd93b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:26.837191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab8d38-d50e-4fb7-adb1-d13c1d3bd93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:26.895389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0dcbf-67a1-4b81-ac8a-d1f4ed9deee1 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:26.895389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4fe0dcbf-67a1-4b81-ac8a-d1f4ed9deee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:26.901428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3fab8d38-d50e-4fb7-adb1-d13c1d3bd93b None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:26.903785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3fab8d38-d50e-4fb7-adb1-d13c1d3bd93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:27.050348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0dcbf-67a1-4b81-ac8a-d1f4ed9deee1 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:27.054040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 869/1720] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:27.063262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2eab6-b0a5-40ab-890a-1dd95106bbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:27.064606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2eab6-b0a5-40ab-890a-1dd95106bbfb service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:27.065030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2eab6-b0a5-40ab-890a-1dd95106bbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:27.065463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2eab6-b0a5-40ab-890a-1dd95106bbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:27.099514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2eab6-b0a5-40ab-890a-1dd95106bbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:27.101042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2eab6-b0a5-40ab-890a-1dd95106bbfb service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:27.127180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 852/1721] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:27.147892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab8d38-d50e-4fb7-adb1-d13c1d3bd93b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:27.149357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3fab8d38-d50e-4fb7-adb1-d13c1d3bd93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:27.172573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab8d38-d50e-4fb7-adb1-d13c1d3bd93b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:27.188519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:27.189411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:27.189696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:27.189964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] PATH_INFO: `/v3/projects/9a2808282d254409ae586637bd52ee15` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:27.191268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2808282d254409ae586637bd52ee15)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:27.193281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:27.374170 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:27.473127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2808282d254409ae586637bd52ee15', 'request_id': 'req-e708f884-b019-4c6e-bda0-98e034ee2201'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:27.504570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2808282d254409ae586637bd52ee15', 'request_id': 'req-e708f884-b019-4c6e-bda0-98e034ee2201'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:27.520562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2808282d254409ae586637bd52ee15', 'request_id': 'req-e708f884-b019-4c6e-bda0-98e034ee2201'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:27.612625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2eab6-b0a5-40ab-890a-1dd95106bbfb service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:27.615133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-24b2eab6-b0a5-40ab-890a-1dd95106bbfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:27.628417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] The token cache is being invalidate because project 9a2808282d254409ae586637bd52ee15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:27.633444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:27.633444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e708f884-b019-4c6e-bda0-98e034ee2201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:27.641452 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 870/1722] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:27 2022] DELETE /identity/v3/projects/9a2808282d254409ae586637bd52ee15 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:27.643244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ed9a0-d6e3-465d-a126-3217a3b56ebe None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:27.647983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ed9a0-d6e3-465d-a126-3217a3b56ebe None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:27.649160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ed9a0-d6e3-465d-a126-3217a3b56ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:27.666406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2eab6-b0a5-40ab-890a-1dd95106bbfb service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:27.731735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-cd4ed9a0-d6e3-465d-a126-3217a3b56ebe None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:27.732967 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cd4ed9a0-d6e3-465d-a126-3217a3b56ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:27.788653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:27.929883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:27.932856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:27.933353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:27.933926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] PATH_INFO: `/v3/users/27eb177c36394ebca2ff7e0f7e6ed63d` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:27.936241 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=27eb177c36394ebca2ff7e0f7e6ed63d)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:27.950753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:27.962642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 871/1723] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:27.964129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ed9a0-d6e3-465d-a126-3217a3b56ebe None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:27.966284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cd4ed9a0-d6e3-465d-a126-3217a3b56ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:28.111595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ed9a0-d6e3-465d-a126-3217a3b56ebe None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:28.122398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd34b7-725b-4569-8968-a18381f4313e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:28.123375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd34b7-725b-4569-8968-a18381f4313e service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:28.123874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd34b7-725b-4569-8968-a18381f4313e service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:28.124149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd34b7-725b-4569-8968-a18381f4313e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:28.126157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-19cd34b7-725b-4569-8968-a18381f4313e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:28.143143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd34b7-725b-4569-8968-a18381f4313e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:28.152278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd34b7-725b-4569-8968-a18381f4313e service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:28.191769 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 872/1724] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:28.193490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085934-3570-4bfd-aabb-98a0bdd8e490 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:28.193490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085934-3570-4bfd-aabb-98a0bdd8e490 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:28.193658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085934-3570-4bfd-aabb-98a0bdd8e490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:28.242211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27eb177c36394ebca2ff7e0f7e6ed63d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:28.245690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27eb177c36394ebca2ff7e0f7e6ed63d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:28.252648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27eb177c36394ebca2ff7e0f7e6ed63d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:28.274532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-af085934-3570-4bfd-aabb-98a0bdd8e490 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:28.278864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-af085934-3570-4bfd-aabb-98a0bdd8e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:28.295303 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27eb177c36394ebca2ff7e0f7e6ed63d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:28.317511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 873/1725] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:28.318952 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af085934-3570-4bfd-aabb-98a0bdd8e490 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:28.325677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-af085934-3570-4bfd-aabb-98a0bdd8e490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:28.344556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27eb177c36394ebca2ff7e0f7e6ed63d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:28.356123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af085934-3570-4bfd-aabb-98a0bdd8e490 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:28.375565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:28.375565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:28.375565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:28.376418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] PATH_INFO: `/v3/projects/a5d08d90c991476c9e4292b90aa82e14` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:28.379118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d08d90c991476c9e4292b90aa82e14)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:28.384293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:28.552752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 853/1726] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:27 2022] DELETE /identity/v3/users/27eb177c36394ebca2ff7e0f7e6ed63d => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:28.553925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:28.612009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d08d90c991476c9e4292b90aa82e14', 'request_id': 'req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:28.633190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d08d90c991476c9e4292b90aa82e14', 'request_id': 'req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:28.644852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26715efc-986b-486f-9f79-d506251bc19f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:28.653625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d08d90c991476c9e4292b90aa82e14', 'request_id': 'req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:28.688797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:28.785365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] The token cache is being invalidate because project a5d08d90c991476c9e4292b90aa82e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:28.795986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:28.795986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-eca91dca-57e1-4ed0-8ca7-cd6bcd235678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:28.795986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 874/1727] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:28 2022] DELETE /identity/v3/projects/a5d08d90c991476c9e4292b90aa82e14 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:28.795986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ed838-b1ac-489e-ac48-35add5f63c33 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:28.795986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ed838-b1ac-489e-ac48-35add5f63c33 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:28.795986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ed838-b1ac-489e-ac48-35add5f63c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:28.838489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3d1ed838-b1ac-489e-ac48-35add5f63c33 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:28.841866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3d1ed838-b1ac-489e-ac48-35add5f63c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:28.860621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe86501-c2f9-467e-8b14-4047b4c6ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:28.861423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe86501-c2f9-467e-8b14-4047b4c6ffc1 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:28.861707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe86501-c2f9-467e-8b14-4047b4c6ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:28.862094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe86501-c2f9-467e-8b14-4047b4c6ffc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:28.862904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe86501-c2f9-467e-8b14-4047b4c6ffc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:28.863288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe86501-c2f9-467e-8b14-4047b4c6ffc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:28.865113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe86501-c2f9-467e-8b14-4047b4c6ffc1 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:28.868954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 875/1728] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:28.870947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7ff27-909e-44f5-b56a-45634d119f5f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:28.872277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7ff27-909e-44f5-b56a-45634d119f5f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:28.872812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7ff27-909e-44f5-b56a-45634d119f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:28.894763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-caf7ff27-909e-44f5-b56a-45634d119f5f None None] MFA Rules not processed for user `f77a4ee31a9e48d18a3be08267eb6236`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:28.904136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-caf7ff27-909e-44f5-b56a-45634d119f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:28.911612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 854/1729] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:28.917720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b74e-a732-4121-abda-6a5c4c272216 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:28.918110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b74e-a732-4121-abda-6a5c4c272216 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:28.918270 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726b74e-a732-4121-abda-6a5c4c272216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:28.985702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f726b74e-a732-4121-abda-6a5c4c272216 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:28.987132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f726b74e-a732-4121-abda-6a5c4c272216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:29.003302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 855/1730] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:29.005249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b74e-a732-4121-abda-6a5c4c272216 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:29.012222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f726b74e-a732-4121-abda-6a5c4c272216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:29.049335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726b74e-a732-4121-abda-6a5c4c272216 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:29.061789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494dad8-0344-4667-8662-ad17cafc220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:29.070037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494dad8-0344-4667-8662-ad17cafc220a admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:29.071023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494dad8-0344-4667-8662-ad17cafc220a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:29.072707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494dad8-0344-4667-8662-ad17cafc220a admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:29.074124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494dad8-0344-4667-8662-ad17cafc220a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:29.077644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494dad8-0344-4667-8662-ad17cafc220a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:29.112720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 876/1731] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:29.113975 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7ff27-909e-44f5-b56a-45634d119f5f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:29.116405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-caf7ff27-909e-44f5-b56a-45634d119f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:29.244721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7ff27-909e-44f5-b56a-45634d119f5f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:29.250582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0a4ed-b9dd-4cf0-9b25-9bd56ddbf227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:29.251368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0a4ed-b9dd-4cf0-9b25-9bd56ddbf227 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:29.251559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0a4ed-b9dd-4cf0-9b25-9bd56ddbf227 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:29.251826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0a4ed-b9dd-4cf0-9b25-9bd56ddbf227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:29.266160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0a4ed-b9dd-4cf0-9b25-9bd56ddbf227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:29.267928 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0a4ed-b9dd-4cf0-9b25-9bd56ddbf227 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:29.277430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 856/1732] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:29 2022] POST /identity/v3/projects => generated 369 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:29.279016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788332ff-2fb3-43a7-99f8-1e7c571e9e49 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:29.279678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788332ff-2fb3-43a7-99f8-1e7c571e9e49 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:29.280537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788332ff-2fb3-43a7-99f8-1e7c571e9e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:29.288240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 877/1733] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:29.289306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0a4ed-b9dd-4cf0-9b25-9bd56ddbf227 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:29.292860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-58b0a4ed-b9dd-4cf0-9b25-9bd56ddbf227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:29.313704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0a4ed-b9dd-4cf0-9b25-9bd56ddbf227 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:29.348175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-788332ff-2fb3-43a7-99f8-1e7c571e9e49 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:29.354883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-788332ff-2fb3-43a7-99f8-1e7c571e9e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:29.469928 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:29.471353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:29.471902 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:29.472517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] PATH_INFO: `/v3/projects/f27369801b1143a78ddd92d4ef6464cc` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:29.475349 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:29.475702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27369801b1143a78ddd92d4ef6464cc)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:29.478043 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:29.518407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 857/1734] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:29.519860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788332ff-2fb3-43a7-99f8-1e7c571e9e49 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:29.543159 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788332ff-2fb3-43a7-99f8-1e7c571e9e49 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:29.551141 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf3194-d282-445e-bc03-debaca8bafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:29.555039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf3194-d282-445e-bc03-debaca8bafc3 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:29.555527 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf3194-d282-445e-bc03-debaca8bafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:29.557823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf3194-d282-445e-bc03-debaca8bafc3 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:29.560998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf3194-d282-445e-bc03-debaca8bafc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:29.564418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caf3194-d282-445e-bc03-debaca8bafc3 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:29.675137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 858/1735] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:29 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:29.675971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf3194-d282-445e-bc03-debaca8bafc3 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:29.688256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf3194-d282-445e-bc03-debaca8bafc3 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:29.701262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27369801b1143a78ddd92d4ef6464cc', 'request_id': 'req-fc5feed1-7f5e-43c3-a838-048eb55394de'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:29.713797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27369801b1143a78ddd92d4ef6464cc', 'request_id': 'req-fc5feed1-7f5e-43c3-a838-048eb55394de'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:29.728694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27369801b1143a78ddd92d4ef6464cc', 'request_id': 'req-fc5feed1-7f5e-43c3-a838-048eb55394de'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:29.787192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7fabf-3daf-4c53-8139-290f2663bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:29.790167 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7fabf-3daf-4c53-8139-290f2663bff3 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:29.791513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7fabf-3daf-4c53-8139-290f2663bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:29.792146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7fabf-3daf-4c53-8139-290f2663bff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:29.798706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7fabf-3daf-4c53-8139-290f2663bff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:29.798706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7fabf-3daf-4c53-8139-290f2663bff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:29.798706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7fabf-3daf-4c53-8139-290f2663bff3 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:29.827480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 859/1736] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:29.827585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] The token cache is being invalidate because project f27369801b1143a78ddd92d4ef6464cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:29.827849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:29.830361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:29.833807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7fabf-3daf-4c53-8139-290f2663bff3 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:29.834933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 878/1737] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:29 2022] DELETE /identity/v3/projects/f27369801b1143a78ddd92d4ef6464cc => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:29.835976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:29.839855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-aaf7fabf-3daf-4c53-8139-290f2663bff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:29.840738 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:29.878796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7fabf-3daf-4c53-8139-290f2663bff3 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:29.899224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5feed1-7f5e-43c3-a838-048eb55394de admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:29.902219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d6516-ca6d-4fda-b9af-1552113d0905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:29.911098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d6516-ca6d-4fda-b9af-1552113d0905 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:29.912033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d6516-ca6d-4fda-b9af-1552113d0905 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:29.916633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d6516-ca6d-4fda-b9af-1552113d0905 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:29.917592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d6516-ca6d-4fda-b9af-1552113d0905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:29.919581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d6516-ca6d-4fda-b9af-1552113d0905 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:29.929266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9018bb-14e7-43a6-8dce-f77fcedd96ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:29.932629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9018bb-14e7-43a6-8dce-f77fcedd96ac admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:29.932629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9018bb-14e7-43a6-8dce-f77fcedd96ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:29.932629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9018bb-14e7-43a6-8dce-f77fcedd96ac admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:29.936065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9018bb-14e7-43a6-8dce-f77fcedd96ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:29.937977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9018bb-14e7-43a6-8dce-f77fcedd96ac admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:29.957771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 860/1738] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:29.962786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d6516-ca6d-4fda-b9af-1552113d0905 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:29.967636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d25d6516-ca6d-4fda-b9af-1552113d0905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:30.012088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d6516-ca6d-4fda-b9af-1552113d0905 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:30.038706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:30.038706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:30.039023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:30.039280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] PATH_INFO: `/v3/users/c5c79bb549aa4e0e84a5cb600e22fbb7` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:30.048021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c79bb549aa4e0e84a5cb600e22fbb7)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:30.048021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:30.141707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 879/1739] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:29 2022] POST /identity/v3/projects => generated 375 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:30.142857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9018bb-14e7-43a6-8dce-f77fcedd96ac admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:30.355588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c79bb549aa4e0e84a5cb600e22fbb7'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:30.356753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c79bb549aa4e0e84a5cb600e22fbb7'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:30.357444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c79bb549aa4e0e84a5cb600e22fbb7'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:30.368354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c79bb549aa4e0e84a5cb600e22fbb7'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:30.395201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9018bb-14e7-43a6-8dce-f77fcedd96ac admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:30.409089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732f8b8-a78b-41d7-a852-8c5ac44d229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:30.413700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732f8b8-a78b-41d7-a852-8c5ac44d229b admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:30.413700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732f8b8-a78b-41d7-a852-8c5ac44d229b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:30.413700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732f8b8-a78b-41d7-a852-8c5ac44d229b admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:30.413700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732f8b8-a78b-41d7-a852-8c5ac44d229b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:30.413700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732f8b8-a78b-41d7-a852-8c5ac44d229b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:30.414252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ba0ac20b-02de-4be7-bdce-1d35a508d443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c79bb549aa4e0e84a5cb600e22fbb7'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:30.453952 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 880/1740] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:30.454898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732f8b8-a78b-41d7-a852-8c5ac44d229b admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:30.461715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1732f8b8-a78b-41d7-a852-8c5ac44d229b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:30.487039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 861/1741] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:29 2022] DELETE /identity/v3/users/c5c79bb549aa4e0e84a5cb600e22fbb7 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:30.488381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871aa58-62e2-4954-9b43-e78c2b16694c None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:30.488660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871aa58-62e2-4954-9b43-e78c2b16694c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:30.490325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871aa58-62e2-4954-9b43-e78c2b16694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:30.504635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732f8b8-a78b-41d7-a852-8c5ac44d229b admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:30.531927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-d871aa58-62e2-4954-9b43-e78c2b16694c None None] MFA Rules not processed for user `7caf8c01365b4918abf24203b7a14dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:30.533479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d871aa58-62e2-4954-9b43-e78c2b16694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:30.661148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 862/1742] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:30.662065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871aa58-62e2-4954-9b43-e78c2b16694c None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:30.663587 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d871aa58-62e2-4954-9b43-e78c2b16694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:30.667847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd06a56-bb24-41af-b3ed-410ba58e467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:30.668456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd06a56-bb24-41af-b3ed-410ba58e467a admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:30.668746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd06a56-bb24-41af-b3ed-410ba58e467a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:30.669028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd06a56-bb24-41af-b3ed-410ba58e467a admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:30.675623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd06a56-bb24-41af-b3ed-410ba58e467a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:30.677614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd06a56-bb24-41af-b3ed-410ba58e467a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:30.689787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871aa58-62e2-4954-9b43-e78c2b16694c None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:30.696535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0d7d-1999-40ee-aba2-d55af52f8b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:30.699015 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0d7d-1999-40ee-aba2-d55af52f8b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:30.699585 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0d7d-1999-40ee-aba2-d55af52f8b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:30.700815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0d7d-1999-40ee-aba2-d55af52f8b2f admin admin] PATH_INFO: `/v3/projects/c2d04d00f0b84050a77986f80e11c44b/users/a1d8bdbe76714958805058916440059e/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:30.739852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a0d7d-1999-40ee-aba2-d55af52f8b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d04d00f0b84050a77986f80e11c44b, user_id=a1d8bdbe76714958805058916440059e, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:30.756097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a0d7d-1999-40ee-aba2-d55af52f8b2f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:30.894793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:31.625654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 863/1743] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:30 2022] PUT /identity/v3/projects/c2d04d00f0b84050a77986f80e11c44b/users/a1d8bdbe76714958805058916440059e/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:31.629810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0d7d-1999-40ee-aba2-d55af52f8b2f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:31.629931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 881/1744] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:30 2022] POST /identity/v3/users => generated 288 bytes in 1173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:31.630028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-558a0d7d-1999-40ee-aba2-d55af52f8b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:31.630130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792eec2-ff06-458b-bcf3-4b10db325122 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:31.630130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792eec2-ff06-458b-bcf3-4b10db325122 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:31.630314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792eec2-ff06-458b-bcf3-4b10db325122 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:31.636818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 882/1745] 10.222.0.42 () {54 vars in 912 bytes} [Fri May 27 14:01:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:01:31.637938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792eec2-ff06-458b-bcf3-4b10db325122 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:31.799901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0d7d-1999-40ee-aba2-d55af52f8b2f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:31.807058 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:31.807966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:31.808195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:31.808468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] PATH_INFO: `/v3/projects/b9c06eaf29d5464bb534eedc7ef9c91a` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:31.809726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c06eaf29d5464bb534eedc7ef9c91a)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:31.812702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:31.835453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792eec2-ff06-458b-bcf3-4b10db325122 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:31.843885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19885d7d-9394-4212-a687-4da2c3c5f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:31.844839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19885d7d-9394-4212-a687-4da2c3c5f476 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:31.845579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19885d7d-9394-4212-a687-4da2c3c5f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:31.850233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19885d7d-9394-4212-a687-4da2c3c5f476 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:31.850233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19885d7d-9394-4212-a687-4da2c3c5f476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:31.851283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19885d7d-9394-4212-a687-4da2c3c5f476 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:31.864740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 883/1746] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:31.869112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7024b1-4f20-421e-b1f6-5cddd4a54a5b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:31.869690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7024b1-4f20-421e-b1f6-5cddd4a54a5b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:31.870215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7024b1-4f20-421e-b1f6-5cddd4a54a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:31.945520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-2f7024b1-4f20-421e-b1f6-5cddd4a54a5b None None] MFA Rules not processed for user `a1d8bdbe76714958805058916440059e`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:31.945520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-2f7024b1-4f20-421e-b1f6-5cddd4a54a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:32.071107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c06eaf29d5464bb534eedc7ef9c91a', 'request_id': 'req-3cff3da8-a62e-4793-a60c-5acc7a11eb00'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:32.081434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c06eaf29d5464bb534eedc7ef9c91a', 'request_id': 'req-3cff3da8-a62e-4793-a60c-5acc7a11eb00'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:32.105807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c06eaf29d5464bb534eedc7ef9c91a', 'request_id': 'req-3cff3da8-a62e-4793-a60c-5acc7a11eb00'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:32.119571 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 884/1747] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:32.124108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedfb8d-1853-4acd-9e33-cedfb91fe7ba None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:32.124108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedfb8d-1853-4acd-9e33-cedfb91fe7ba None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:32.124108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedfb8d-1853-4acd-9e33-cedfb91fe7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:32.192986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8aedfb8d-1853-4acd-9e33-cedfb91fe7ba None None] MFA Rules not processed for user `7afc19dc502f425faf693eb963fe63d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:32.197035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8aedfb8d-1853-4acd-9e33-cedfb91fe7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:32.225345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] The token cache is being invalidate because project b9c06eaf29d5464bb534eedc7ef9c91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:32.226250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:32.226911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:32.230352 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 864/1748] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:31 2022] DELETE /identity/v3/projects/b9c06eaf29d5464bb534eedc7ef9c91a => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:32.233066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:32.242193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:32.293625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 885/1749] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:32.294817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedfb8d-1853-4acd-9e33-cedfb91fe7ba None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:32.296466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8aedfb8d-1853-4acd-9e33-cedfb91fe7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:32.409557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff3da8-a62e-4793-a60c-5acc7a11eb00 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:32.416819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b4332-95ba-4c02-88fd-18eff424978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:32.417036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b4332-95ba-4c02-88fd-18eff424978d admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:32.417322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b4332-95ba-4c02-88fd-18eff424978d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:32.417599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b4332-95ba-4c02-88fd-18eff424978d admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:32.418601 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b4332-95ba-4c02-88fd-18eff424978d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:32.420816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b4332-95ba-4c02-88fd-18eff424978d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:32.427684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedfb8d-1853-4acd-9e33-cedfb91fe7ba None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:32.434588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4712a47-268d-401a-94b6-f58ded64ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:32.435417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4712a47-268d-401a-94b6-f58ded64ca95 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:32.435988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4712a47-268d-401a-94b6-f58ded64ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:32.436928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 865/1750] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:32.437947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b4332-95ba-4c02-88fd-18eff424978d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:32.440270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4712a47-268d-401a-94b6-f58ded64ca95 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:32.441673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4d7b4332-95ba-4c02-88fd-18eff424978d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:32.442435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:32.443198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4712a47-268d-401a-94b6-f58ded64ca95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:32.445933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4712a47-268d-401a-94b6-f58ded64ca95 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:32.461765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b4332-95ba-4c02-88fd-18eff424978d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:32.469616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:32.472495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:32.472495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:32.472495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] PATH_INFO: `/v3/users/f1ad02d1f5c24d72948b15fc5ee1c7cd` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:32.472495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ad02d1f5c24d72948b15fc5ee1c7cd)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:32.474764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:32.586044 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 886/1751] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:32 2022] POST /identity/v3/projects => generated 371 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:32.587589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4712a47-268d-401a-94b6-f58ded64ca95 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:32.588262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:32.593180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b4712a47-268d-401a-94b6-f58ded64ca95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:32.675042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4712a47-268d-401a-94b6-f58ded64ca95 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:32.680252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350aa7-73f0-4921-bf3f-7ace732fe092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:32.681145 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350aa7-73f0-4921-bf3f-7ace732fe092 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:32.681951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350aa7-73f0-4921-bf3f-7ace732fe092 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:32.682242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5350aa7-73f0-4921-bf3f-7ace732fe092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:32.692534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5350aa7-73f0-4921-bf3f-7ace732fe092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:32.694157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5350aa7-73f0-4921-bf3f-7ace732fe092 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:32.706574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ad02d1f5c24d72948b15fc5ee1c7cd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:32.708108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ad02d1f5c24d72948b15fc5ee1c7cd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:32.708878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ad02d1f5c24d72948b15fc5ee1c7cd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:32.710893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 887/1752] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:32.719700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ad02d1f5c24d72948b15fc5ee1c7cd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:32.729256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350aa7-73f0-4921-bf3f-7ace732fe092 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:32.732932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f5350aa7-73f0-4921-bf3f-7ace732fe092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:32.742953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ad02d1f5c24d72948b15fc5ee1c7cd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:32.831056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 866/1753] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:32 2022] DELETE /identity/v3/users/f1ad02d1f5c24d72948b15fc5ee1c7cd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:32.832148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:32.833590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:32.887786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5350aa7-73f0-4921-bf3f-7ace732fe092 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:32.957188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c047b-5a40-4521-96ea-80616837eb0a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:32.962879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:32.962879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:32.962879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:32.964965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] PATH_INFO: `/v3/projects/34c860a54119433ca70afe10f98e8534` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:32.967054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c860a54119433ca70afe10f98e8534)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:32.970400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:32.972181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebb2b4-e765-4e56-a68a-09610fe2a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:32.974638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb2b4-e765-4e56-a68a-09610fe2a469 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:32.974926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb2b4-e765-4e56-a68a-09610fe2a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:32.975237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb2b4-e765-4e56-a68a-09610fe2a469 admin admin] PATH_INFO: `/v3/projects/06aab54ee43b4d4a8e813fab4def5117/users/6f4fd3eb14ba459ba83eb569b135d16e/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:33.013131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebb2b4-e765-4e56-a68a-09610fe2a469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06aab54ee43b4d4a8e813fab4def5117, user_id=6f4fd3eb14ba459ba83eb569b135d16e, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:33.015952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebb2b4-e765-4e56-a68a-09610fe2a469 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:33.125747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 867/1754] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:32 2022] PUT /identity/v3/projects/06aab54ee43b4d4a8e813fab4def5117/users/6f4fd3eb14ba459ba83eb569b135d16e/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:33.126594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebb2b4-e765-4e56-a68a-09610fe2a469 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:33.132567 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5eebb2b4-e765-4e56-a68a-09610fe2a469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:33.157354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c860a54119433ca70afe10f98e8534', 'request_id': 'req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:33.173356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c860a54119433ca70afe10f98e8534', 'request_id': 'req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:33.190250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c860a54119433ca70afe10f98e8534', 'request_id': 'req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:33.299367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebb2b4-e765-4e56-a68a-09610fe2a469 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:33.327804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] The token cache is being invalidate because project 34c860a54119433ca70afe10f98e8534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:33.328106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:33.329846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-61ba9ed0-4e74-4eb7-ad6d-e0fbe032c58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:33.334729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 888/1755] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:32 2022] DELETE /identity/v3/projects/34c860a54119433ca70afe10f98e8534 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:33.339858 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9e22-819d-4f09-95c7-19fc7eec32a7 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:33.341475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9e22-819d-4f09-95c7-19fc7eec32a7 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:33.342848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc9e22-819d-4f09-95c7-19fc7eec32a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:33.435280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a4dc9e22-819d-4f09-95c7-19fc7eec32a7 None None] MFA Rules not processed for user `6f4fd3eb14ba459ba83eb569b135d16e`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:33.438608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a4dc9e22-819d-4f09-95c7-19fc7eec32a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:33.486573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae71e3a-4341-457b-b75d-29a528f65d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:33.487337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae71e3a-4341-457b-b75d-29a528f65d67 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:33.487619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae71e3a-4341-457b-b75d-29a528f65d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:33.496192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae71e3a-4341-457b-b75d-29a528f65d67 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:33.496192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae71e3a-4341-457b-b75d-29a528f65d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:33.496192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae71e3a-4341-457b-b75d-29a528f65d67 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:33.619417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 868/1756] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:33 2022] POST /identity/v3/users => generated 292 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:33.621203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feab49f-ad7a-4499-9cb2-63e694530e6e None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:33.623874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feab49f-ad7a-4499-9cb2-63e694530e6e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:33.626426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feab49f-ad7a-4499-9cb2-63e694530e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:33.640056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 889/1757] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:33.645328 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc9e22-819d-4f09-95c7-19fc7eec32a7 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:33.656726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a4dc9e22-819d-4f09-95c7-19fc7eec32a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:33.693225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc9e22-819d-4f09-95c7-19fc7eec32a7 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:33.704625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-2feab49f-ad7a-4499-9cb2-63e694530e6e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:33.705440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55baf60-413c-4cc7-9792-738ecb2db270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:33.705957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2feab49f-ad7a-4499-9cb2-63e694530e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:33.706206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55baf60-413c-4cc7-9792-738ecb2db270 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:33.706478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55baf60-413c-4cc7-9792-738ecb2db270 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:33.706760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55baf60-413c-4cc7-9792-738ecb2db270 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:33.707641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55baf60-413c-4cc7-9792-738ecb2db270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:33.712232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55baf60-413c-4cc7-9792-738ecb2db270 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:33.733131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 890/1758] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:33.733131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55baf60-413c-4cc7-9792-738ecb2db270 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:33.734723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d55baf60-413c-4cc7-9792-738ecb2db270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:33.749105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 869/1759] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:33.752339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feab49f-ad7a-4499-9cb2-63e694530e6e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:33.757178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55baf60-413c-4cc7-9792-738ecb2db270 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:33.763273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cacbb4-dc8c-4883-baac-4750ceb7a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:33.763964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cacbb4-dc8c-4883-baac-4750ceb7a076 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:33.764248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cacbb4-dc8c-4883-baac-4750ceb7a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:33.764530 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cacbb4-dc8c-4883-baac-4750ceb7a076 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:33.765310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cacbb4-dc8c-4883-baac-4750ceb7a076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:33.769715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cacbb4-dc8c-4883-baac-4750ceb7a076 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:33.778623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feab49f-ad7a-4499-9cb2-63e694530e6e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:33.795987 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d045b3-dbcf-4dd7-a909-8573a691c620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:33.804244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d045b3-dbcf-4dd7-a909-8573a691c620 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:33.804244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d045b3-dbcf-4dd7-a909-8573a691c620 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:33.805241 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d045b3-dbcf-4dd7-a909-8573a691c620 admin admin] PATH_INFO: `/v3/projects/5ea629c6938a41649381a61ed728f6f7/users/92b381ccf4064587b474f4ef78be423c/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:33.832860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d045b3-dbcf-4dd7-a909-8573a691c620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea629c6938a41649381a61ed728f6f7, user_id=92b381ccf4064587b474f4ef78be423c, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:33.832860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d045b3-dbcf-4dd7-a909-8573a691c620 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:33.888102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 891/1760] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:33 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:33.888102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3192d0e-2192-4fca-8b19-56890931ebb5 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:33.888102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3192d0e-2192-4fca-8b19-56890931ebb5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:33.888102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3192d0e-2192-4fca-8b19-56890931ebb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:33.909730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a3192d0e-2192-4fca-8b19-56890931ebb5 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:33.913864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a3192d0e-2192-4fca-8b19-56890931ebb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:33.949361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 870/1761] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:33 2022] PUT /identity/v3/projects/5ea629c6938a41649381a61ed728f6f7/users/92b381ccf4064587b474f4ef78be423c/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:33.965703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d045b3-dbcf-4dd7-a909-8573a691c620 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:33.965703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-22d045b3-dbcf-4dd7-a909-8573a691c620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:33.974869 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 892/1762] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:33.975707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3192d0e-2192-4fca-8b19-56890931ebb5 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:33.991536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3192d0e-2192-4fca-8b19-56890931ebb5 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:34.047154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d045b3-dbcf-4dd7-a909-8573a691c620 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:34.057826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:34.068966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.068966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.068966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] PATH_INFO: `/v3/projects/4a09379acf024dd8a51fbfdcf499cf66` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.068966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a09379acf024dd8a51fbfdcf499cf66)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:34.069412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c2ab8-c956-46b7-a97b-fdd19ae3cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:34.069412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c2ab8-c956-46b7-a97b-fdd19ae3cc9c admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.069412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c2ab8-c956-46b7-a97b-fdd19ae3cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.069412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c2ab8-c956-46b7-a97b-fdd19ae3cc9c admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.069748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:34.069822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c2ab8-c956-46b7-a97b-fdd19ae3cc9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:34.069822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c2ab8-c956-46b7-a97b-fdd19ae3cc9c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:34.197289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 893/1763] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:33 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:34.198191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c2ab8-c956-46b7-a97b-fdd19ae3cc9c admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:34.208333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c2ab8-c956-46b7-a97b-fdd19ae3cc9c admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:34.215663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052235c-8a1c-474b-9c93-921db0b55332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:34.218161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052235c-8a1c-474b-9c93-921db0b55332 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.218161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052235c-8a1c-474b-9c93-921db0b55332 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.218161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052235c-8a1c-474b-9c93-921db0b55332 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.218161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052235c-8a1c-474b-9c93-921db0b55332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:34.220509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052235c-8a1c-474b-9c93-921db0b55332 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:34.232370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 894/1764] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:34.233359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052235c-8a1c-474b-9c93-921db0b55332 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:34.244464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052235c-8a1c-474b-9c93-921db0b55332 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:34.269011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a09379acf024dd8a51fbfdcf499cf66', 'request_id': 'req-315df8bd-b04d-4bb3-8844-35548cf7c12f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:34.287771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a09379acf024dd8a51fbfdcf499cf66', 'request_id': 'req-315df8bd-b04d-4bb3-8844-35548cf7c12f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:34.304164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a09379acf024dd8a51fbfdcf499cf66', 'request_id': 'req-315df8bd-b04d-4bb3-8844-35548cf7c12f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:34.337054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af032-686f-4ba8-9f02-1ba041142398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:34.337749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af032-686f-4ba8-9f02-1ba041142398 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.338672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af032-686f-4ba8-9f02-1ba041142398 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.338672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af032-686f-4ba8-9f02-1ba041142398 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.339252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af032-686f-4ba8-9f02-1ba041142398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:34.339564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af032-686f-4ba8-9f02-1ba041142398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:34.341244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af032-686f-4ba8-9f02-1ba041142398 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:34.358803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 895/1765] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:34.359733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af032-686f-4ba8-9f02-1ba041142398 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:34.375259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af032-686f-4ba8-9f02-1ba041142398 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:34.381729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9097d-922b-4a6f-add6-a0d48a6c81b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:34.382441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9097d-922b-4a6f-add6-a0d48a6c81b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.382731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9097d-922b-4a6f-add6-a0d48a6c81b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.383031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9097d-922b-4a6f-add6-a0d48a6c81b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.384199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9097d-922b-4a6f-add6-a0d48a6c81b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:34.391556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9097d-922b-4a6f-add6-a0d48a6c81b5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:34.408412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] The token cache is being invalidate because project 4a09379acf024dd8a51fbfdcf499cf66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:34.420177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:34.420305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 896/1766] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:34.420305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9097d-922b-4a6f-add6-a0d48a6c81b5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:34.420459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:34.420459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 871/1767] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:33 2022] DELETE /identity/v3/projects/4a09379acf024dd8a51fbfdcf499cf66 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:34.420459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:34.420459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:34.429433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9097d-922b-4a6f-add6-a0d48a6c81b5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:34.436216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2be802-9a30-435e-8d93-b7a7c1be2aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:34.437244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2be802-9a30-435e-8d93-b7a7c1be2aef admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.437594 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2be802-9a30-435e-8d93-b7a7c1be2aef admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.437935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2be802-9a30-435e-8d93-b7a7c1be2aef admin admin] PATH_INFO: `/v3/projects/5ea629c6938a41649381a61ed728f6f7/users/92b381ccf4064587b474f4ef78be423c/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.440434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2be802-9a30-435e-8d93-b7a7c1be2aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea629c6938a41649381a61ed728f6f7, user_id=92b381ccf4064587b474f4ef78be423c, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:34.443203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2be802-9a30-435e-8d93-b7a7c1be2aef admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:34.454283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315df8bd-b04d-4bb3-8844-35548cf7c12f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:34.454283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6499011-6a11-4bfc-94bf-244e2125996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:34.454283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6499011-6a11-4bfc-94bf-244e2125996b admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.454283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6499011-6a11-4bfc-94bf-244e2125996b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.454662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6499011-6a11-4bfc-94bf-244e2125996b admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.454662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6499011-6a11-4bfc-94bf-244e2125996b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:34.456171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6499011-6a11-4bfc-94bf-244e2125996b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:34.457470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 897/1768] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:34 2022] PUT /identity/v3/projects/5ea629c6938a41649381a61ed728f6f7/users/92b381ccf4064587b474f4ef78be423c/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:34.458303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2be802-9a30-435e-8d93-b7a7c1be2aef admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:34.460169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ec2be802-9a30-435e-8d93-b7a7c1be2aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:34.504622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:34.542095 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2be802-9a30-435e-8d93-b7a7c1be2aef admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:34.547305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680ea2e-8afa-4cd2-94f3-cfd857932ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:34.548394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ea2e-8afa-4cd2-94f3-cfd857932ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.548839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ea2e-8afa-4cd2-94f3-cfd857932ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.549673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ea2e-8afa-4cd2-94f3-cfd857932ca2 admin admin] PATH_INFO: `/v3/projects/b8668fb7a1b0436e90ec316886b50d8e/users/769d05f515414860b8573fda641e0bea/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.567021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680ea2e-8afa-4cd2-94f3-cfd857932ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8668fb7a1b0436e90ec316886b50d8e, user_id=769d05f515414860b8573fda641e0bea, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:34.575784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680ea2e-8afa-4cd2-94f3-cfd857932ca2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:34.611310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 872/1769] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:34 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:34.611310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ab6d-e6f3-4d6d-8390-0268e1f88478 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.611310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ab6d-e6f3-4d6d-8390-0268e1f88478 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.611310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413ab6d-e6f3-4d6d-8390-0268e1f88478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.632881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-7413ab6d-e6f3-4d6d-8390-0268e1f88478 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:34.635258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7413ab6d-e6f3-4d6d-8390-0268e1f88478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:34.713512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 898/1770] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:34 2022] PUT /identity/v3/projects/b8668fb7a1b0436e90ec316886b50d8e/users/769d05f515414860b8573fda641e0bea/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:34.713512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1a3e6-f3a6-40cd-a6f1-241a668d67f1 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.713512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1a3e6-f3a6-40cd-a6f1-241a668d67f1 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.713512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1a3e6-f3a6-40cd-a6f1-241a668d67f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.738580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 873/1771] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:34.738580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413ab6d-e6f3-4d6d-8390-0268e1f88478 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:34.745172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:34.751266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413ab6d-e6f3-4d6d-8390-0268e1f88478 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:34.798772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d1f1a3e6-f3a6-40cd-a6f1-241a668d67f1 None None] MFA Rules not processed for user `92b381ccf4064587b474f4ef78be423c`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:34.806552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d1f1a3e6-f3a6-40cd-a6f1-241a668d67f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:34.886015 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc33a33-23d8-43da-b5d2-8ddf539a0db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:34.886679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33a33-23d8-43da-b5d2-8ddf539a0db3 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.886992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33a33-23d8-43da-b5d2-8ddf539a0db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.887267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33a33-23d8-43da-b5d2-8ddf539a0db3 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.887998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc33a33-23d8-43da-b5d2-8ddf539a0db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:34.889964 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc33a33-23d8-43da-b5d2-8ddf539a0db3 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:34.936557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 899/1772] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:34.937570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1a3e6-f3a6-40cd-a6f1-241a668d67f1 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:34.949614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1a3e6-f3a6-40cd-a6f1-241a668d67f1 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:34.955074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1214b-9b43-4eb1-9e94-bcc2cacea1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:34.955851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1214b-9b43-4eb1-9e94-bcc2cacea1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.956172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1214b-9b43-4eb1-9e94-bcc2cacea1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.956745 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1214b-9b43-4eb1-9e94-bcc2cacea1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.957570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1214b-9b43-4eb1-9e94-bcc2cacea1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:34.959261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1214b-9b43-4eb1-9e94-bcc2cacea1e4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:34.971469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 900/1773] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:34.972971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d23103-6b90-4833-8f8a-21f4e06f2471 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:34.973313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d23103-6b90-4833-8f8a-21f4e06f2471 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:34.973614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d23103-6b90-4833-8f8a-21f4e06f2471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:34.996097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-68d23103-6b90-4833-8f8a-21f4e06f2471 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:34.997548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-68d23103-6b90-4833-8f8a-21f4e06f2471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:35.004701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 874/1774] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:34 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:35.005656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc33a33-23d8-43da-b5d2-8ddf539a0db3 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.008151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9fc33a33-23d8-43da-b5d2-8ddf539a0db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:35.021469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 901/1775] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:35.022473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d23103-6b90-4833-8f8a-21f4e06f2471 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.037021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d23103-6b90-4833-8f8a-21f4e06f2471 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.038471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c43e2d-5c6f-4c08-9aa2-8fa7f490a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.039439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c43e2d-5c6f-4c08-9aa2-8fa7f490a9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.039739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c43e2d-5c6f-4c08-9aa2-8fa7f490a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.040200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c43e2d-5c6f-4c08-9aa2-8fa7f490a9e4 admin admin] PATH_INFO: `/v3/projects/b8668fb7a1b0436e90ec316886b50d8e/users/769d05f515414860b8573fda641e0bea/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.043205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c43e2d-5c6f-4c08-9aa2-8fa7f490a9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8668fb7a1b0436e90ec316886b50d8e, user_id=769d05f515414860b8573fda641e0bea, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.045851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c43e2d-5c6f-4c08-9aa2-8fa7f490a9e4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.062216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 902/1776] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:35 2022] PUT /identity/v3/projects/b8668fb7a1b0436e90ec316886b50d8e/users/769d05f515414860b8573fda641e0bea/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:35.063211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c43e2d-5c6f-4c08-9aa2-8fa7f490a9e4 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.114995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc33a33-23d8-43da-b5d2-8ddf539a0db3 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.155221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c43e2d-5c6f-4c08-9aa2-8fa7f490a9e4 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.165594 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6457a-003f-45b7-8fa6-f348dde26362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.166256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6457a-003f-45b7-8fa6-f348dde26362 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.166675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6457a-003f-45b7-8fa6-f348dde26362 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.167150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6457a-003f-45b7-8fa6-f348dde26362 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.167784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6457a-003f-45b7-8fa6-f348dde26362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.169430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6457a-003f-45b7-8fa6-f348dde26362 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.174865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808687-99ac-4ea3-84da-4890cf5e3480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.175557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808687-99ac-4ea3-84da-4890cf5e3480 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.175844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808687-99ac-4ea3-84da-4890cf5e3480 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.176119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808687-99ac-4ea3-84da-4890cf5e3480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.180020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 903/1777] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:35.180680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6457a-003f-45b7-8fa6-f348dde26362 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.190415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6457a-003f-45b7-8fa6-f348dde26362 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.195355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f9f74-8db9-462a-89dc-119f31704d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.196088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f9f74-8db9-462a-89dc-119f31704d24 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.196945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f9f74-8db9-462a-89dc-119f31704d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.197330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f9f74-8db9-462a-89dc-119f31704d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.198844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f9f74-8db9-462a-89dc-119f31704d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:35.198844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f9f74-8db9-462a-89dc-119f31704d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.200186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f9f74-8db9-462a-89dc-119f31704d24 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.213408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 904/1778] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:35.217720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c73229-e529-4ccd-8081-a9dc65dd0c07 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.217720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c73229-e529-4ccd-8081-a9dc65dd0c07 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.217720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c73229-e529-4ccd-8081-a9dc65dd0c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.245669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f1c73229-e529-4ccd-8081-a9dc65dd0c07 None None] MFA Rules not processed for user `769d05f515414860b8573fda641e0bea`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:35.245669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f1c73229-e529-4ccd-8081-a9dc65dd0c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:35.251263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da808687-99ac-4ea3-84da-4890cf5e3480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.252877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da808687-99ac-4ea3-84da-4890cf5e3480 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.263443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 875/1779] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:35.264266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808687-99ac-4ea3-84da-4890cf5e3480 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.274558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808687-99ac-4ea3-84da-4890cf5e3480 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.280766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028ec55-f604-401b-ab14-dea3ea57f22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.283249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028ec55-f604-401b-ab14-dea3ea57f22c admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.283566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028ec55-f604-401b-ab14-dea3ea57f22c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.283855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028ec55-f604-401b-ab14-dea3ea57f22c admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.284770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028ec55-f604-401b-ab14-dea3ea57f22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.286714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028ec55-f604-401b-ab14-dea3ea57f22c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.301192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 876/1780] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:35.301192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028ec55-f604-401b-ab14-dea3ea57f22c admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.310492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028ec55-f604-401b-ab14-dea3ea57f22c admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.315049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bd226-bff9-402c-9161-9f342436d7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.315661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bd226-bff9-402c-9161-9f342436d7ab admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.315948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bd226-bff9-402c-9161-9f342436d7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.316221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bd226-bff9-402c-9161-9f342436d7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.316906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bd226-bff9-402c-9161-9f342436d7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.318805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bd226-bff9-402c-9161-9f342436d7ab admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.319307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 905/1781] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:35.323646 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c73229-e529-4ccd-8081-a9dc65dd0c07 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.335542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c73229-e529-4ccd-8081-a9dc65dd0c07 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.340842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4d8c-f985-4667-8ef6-5efb0e297846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.341789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4d8c-f985-4667-8ef6-5efb0e297846 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.341997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4d8c-f985-4667-8ef6-5efb0e297846 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.342273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba4d8c-f985-4667-8ef6-5efb0e297846 admin admin] PATH_INFO: `/v3/projects/218ce759a8014729871b6dcb4e012a58/users/0cf97e8b0bf1412092352139554599b2/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.357498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba4d8c-f985-4667-8ef6-5efb0e297846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=218ce759a8014729871b6dcb4e012a58, user_id=0cf97e8b0bf1412092352139554599b2, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.360288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba4d8c-f985-4667-8ef6-5efb0e297846 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.442301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 877/1782] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:35 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:35.443359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bd226-bff9-402c-9161-9f342436d7ab admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.445705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7c2bd226-bff9-402c-9161-9f342436d7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:35.466461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 906/1783] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:35 2022] PUT /identity/v3/projects/218ce759a8014729871b6dcb4e012a58/users/0cf97e8b0bf1412092352139554599b2/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:35.475772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4d8c-f985-4667-8ef6-5efb0e297846 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.521472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bd226-bff9-402c-9161-9f342436d7ab admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.533453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba4d8c-f985-4667-8ef6-5efb0e297846 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.538292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b04bd-7d5e-4822-8888-a7151cfa721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.538954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b04bd-7d5e-4822-8888-a7151cfa721c admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.539264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b04bd-7d5e-4822-8888-a7151cfa721c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.539542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b04bd-7d5e-4822-8888-a7151cfa721c admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.540279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b04bd-7d5e-4822-8888-a7151cfa721c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.542192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b04bd-7d5e-4822-8888-a7151cfa721c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.569346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827a569-6e1e-45e0-aa6d-012effaaea86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.569997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827a569-6e1e-45e0-aa6d-012effaaea86 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.570286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827a569-6e1e-45e0-aa6d-012effaaea86 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.570561 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827a569-6e1e-45e0-aa6d-012effaaea86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.573123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d827a569-6e1e-45e0-aa6d-012effaaea86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:35.620102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 907/1784] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:35 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:35.621774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895b118-e215-4c27-baca-182890ab9f83 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.622080 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895b118-e215-4c27-baca-182890ab9f83 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.622344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895b118-e215-4c27-baca-182890ab9f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.632053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827a569-6e1e-45e0-aa6d-012effaaea86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.633523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827a569-6e1e-45e0-aa6d-012effaaea86 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.644355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 878/1785] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:35.645194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827a569-6e1e-45e0-aa6d-012effaaea86 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.651532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7895b118-e215-4c27-baca-182890ab9f83 None None] MFA Rules not processed for user `0cf97e8b0bf1412092352139554599b2`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:35.652816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7895b118-e215-4c27-baca-182890ab9f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:35.653926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827a569-6e1e-45e0-aa6d-012effaaea86 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.658116 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7df9b2-c640-4658-8c6c-524b7ff50be0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.658868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7df9b2-c640-4658-8c6c-524b7ff50be0 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.659282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7df9b2-c640-4658-8c6c-524b7ff50be0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.659490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7df9b2-c640-4658-8c6c-524b7ff50be0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.661369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7a7df9b2-c640-4658-8c6c-524b7ff50be0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:35.690661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:35.723809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:35.732358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 908/1786] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:35.733293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895b118-e215-4c27-baca-182890ab9f83 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.738730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7df9b2-c640-4658-8c6c-524b7ff50be0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.740841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7df9b2-c640-4658-8c6c-524b7ff50be0 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.744508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895b118-e215-4c27-baca-182890ab9f83 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.750104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bded5-8a6c-4d7b-bb1a-152f82e9620f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.750870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bded5-8a6c-4d7b-bb1a-152f82e9620f admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.751220 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bded5-8a6c-4d7b-bb1a-152f82e9620f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.751482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bded5-8a6c-4d7b-bb1a-152f82e9620f admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.752218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bded5-8a6c-4d7b-bb1a-152f82e9620f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.752338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 879/1787] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:35.753254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7df9b2-c640-4658-8c6c-524b7ff50be0 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.753874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bded5-8a6c-4d7b-bb1a-152f82e9620f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.765844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7df9b2-c640-4658-8c6c-524b7ff50be0 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.765987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 909/1788] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:35.770034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bded5-8a6c-4d7b-bb1a-152f82e9620f admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.771461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066c9d8-a864-4da8-99fe-5005d2a02b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.772285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c9d8-a864-4da8-99fe-5005d2a02b4a admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.772586 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c9d8-a864-4da8-99fe-5005d2a02b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.772866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c9d8-a864-4da8-99fe-5005d2a02b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.773566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066c9d8-a864-4da8-99fe-5005d2a02b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.775732 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066c9d8-a864-4da8-99fe-5005d2a02b4a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.783638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bded5-8a6c-4d7b-bb1a-152f82e9620f admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.789996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089971d-6d47-47b0-91e1-45c66230ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.795668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089971d-6d47-47b0-91e1-45c66230ffb4 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.796195 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089971d-6d47-47b0-91e1-45c66230ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.796726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089971d-6d47-47b0-91e1-45c66230ffb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.797600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089971d-6d47-47b0-91e1-45c66230ffb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.799478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089971d-6d47-47b0-91e1-45c66230ffb4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.814755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 910/1789] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:35.818945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089971d-6d47-47b0-91e1-45c66230ffb4 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.831929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089971d-6d47-47b0-91e1-45c66230ffb4 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.836682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0021d56-9819-426d-9b1e-55200d2272e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.837880 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0021d56-9819-426d-9b1e-55200d2272e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.838156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0021d56-9819-426d-9b1e-55200d2272e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.838494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0021d56-9819-426d-9b1e-55200d2272e5 admin admin] PATH_INFO: `/v3/projects/89d4c307cb764b2eaa5224df0546601a/users/2e2caf353b124cda9d049f2245aec906/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.853544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0021d56-9819-426d-9b1e-55200d2272e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d4c307cb764b2eaa5224df0546601a, user_id=2e2caf353b124cda9d049f2245aec906, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.856221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0021d56-9819-426d-9b1e-55200d2272e5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.866047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 880/1790] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:35 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:35.870937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066c9d8-a864-4da8-99fe-5005d2a02b4a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:35.937335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066c9d8-a864-4da8-99fe-5005d2a02b4a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:35.942172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb6771-dab1-4c25-b421-c10f99a02317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:35.942848 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb6771-dab1-4c25-b421-c10f99a02317 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:35.943165 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb6771-dab1-4c25-b421-c10f99a02317 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:35.943910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb6771-dab1-4c25-b421-c10f99a02317 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:35.944618 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb6771-dab1-4c25-b421-c10f99a02317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:35.947340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb6771-dab1-4c25-b421-c10f99a02317 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:35.999570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 911/1791] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:35 2022] PUT /identity/v3/projects/89d4c307cb764b2eaa5224df0546601a/users/2e2caf353b124cda9d049f2245aec906/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:36.010212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd8d83-f685-4a87-bcf9-77acb7555e5b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.010439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd8d83-f685-4a87-bcf9-77acb7555e5b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.010720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd8d83-f685-4a87-bcf9-77acb7555e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.036597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-12bd8d83-f685-4a87-bcf9-77acb7555e5b None None] MFA Rules not processed for user `2e2caf353b124cda9d049f2245aec906`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:36.037800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-12bd8d83-f685-4a87-bcf9-77acb7555e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:36.112681 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 912/1792] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:36.124484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd8d83-f685-4a87-bcf9-77acb7555e5b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:36.131890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 881/1793] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:35 2022] POST /identity/v3/users => generated 296 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:36.137283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb6771-dab1-4c25-b421-c10f99a02317 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:36.159028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb6771-dab1-4c25-b421-c10f99a02317 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:36.191231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd8d83-f685-4a87-bcf9-77acb7555e5b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:36.195902 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98f6db-0ed6-49b4-ae78-d485bc01c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:36.196699 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f6db-0ed6-49b4-ae78-d485bc01c327 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.196992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f6db-0ed6-49b4-ae78-d485bc01c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.197269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98f6db-0ed6-49b4-ae78-d485bc01c327 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.197978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98f6db-0ed6-49b4-ae78-d485bc01c327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:36.199976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98f6db-0ed6-49b4-ae78-d485bc01c327 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:36.221630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439e6cf-7c86-4a01-9a20-26a45c7df4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:36.222382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439e6cf-7c86-4a01-9a20-26a45c7df4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.222669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439e6cf-7c86-4a01-9a20-26a45c7df4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.222947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439e6cf-7c86-4a01-9a20-26a45c7df4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.223750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439e6cf-7c86-4a01-9a20-26a45c7df4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:36.225386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439e6cf-7c86-4a01-9a20-26a45c7df4d6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:36.236287 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 882/1794] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:36.240260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439e6cf-7c86-4a01-9a20-26a45c7df4d6 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:36.250487 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439e6cf-7c86-4a01-9a20-26a45c7df4d6 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:36.255309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc226b78-ac75-47d4-814d-5dcda5185a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:36.256191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc226b78-ac75-47d4-814d-5dcda5185a02 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.256468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc226b78-ac75-47d4-814d-5dcda5185a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.256741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc226b78-ac75-47d4-814d-5dcda5185a02 admin admin] PATH_INFO: `/v3/projects/7f0669b341f64a85bfd989f2886ebf01/users/ea353647acae4f60a405f3438ceda4b5/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.271768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc226b78-ac75-47d4-814d-5dcda5185a02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0669b341f64a85bfd989f2886ebf01, user_id=ea353647acae4f60a405f3438ceda4b5, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:36.274362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc226b78-ac75-47d4-814d-5dcda5185a02 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:36.341739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 913/1795] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:36 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:36.345489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98f6db-0ed6-49b4-ae78-d485bc01c327 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:36.384158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 883/1796] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:36 2022] PUT /identity/v3/projects/7f0669b341f64a85bfd989f2886ebf01/users/ea353647acae4f60a405f3438ceda4b5/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:36.385426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc226b78-ac75-47d4-814d-5dcda5185a02 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:36.422874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98f6db-0ed6-49b4-ae78-d485bc01c327 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:36.464513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc226b78-ac75-47d4-814d-5dcda5185a02 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:36.469671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee752-7ae9-474b-a36b-af0ba968c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:36.470517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee752-7ae9-474b-a36b-af0ba968c2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.470851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee752-7ae9-474b-a36b-af0ba968c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.471380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdee752-7ae9-474b-a36b-af0ba968c2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.472250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee752-7ae9-474b-a36b-af0ba968c2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:36.473963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdee752-7ae9-474b-a36b-af0ba968c2d8 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:36.486085 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 884/1797] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:36.495986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee752-7ae9-474b-a36b-af0ba968c2d8 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:36.504486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b4645-4892-4849-8201-db475baf4cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:36.504486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b4645-4892-4849-8201-db475baf4cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.504486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b4645-4892-4849-8201-db475baf4cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.504486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b4645-4892-4849-8201-db475baf4cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.507335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b4645-4892-4849-8201-db475baf4cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:36.507335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b4645-4892-4849-8201-db475baf4cb1 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:36.507487 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdee752-7ae9-474b-a36b-af0ba968c2d8 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:36.512961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98b8ed-88d5-486d-9846-ff0e16679e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:36.513858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98b8ed-88d5-486d-9846-ff0e16679e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.514146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98b8ed-88d5-486d-9846-ff0e16679e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.514424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98b8ed-88d5-486d-9846-ff0e16679e26 admin admin] PATH_INFO: `/v3/projects/7f0669b341f64a85bfd989f2886ebf01/users/ea353647acae4f60a405f3438ceda4b5/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.517261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98b8ed-88d5-486d-9846-ff0e16679e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0669b341f64a85bfd989f2886ebf01, user_id=ea353647acae4f60a405f3438ceda4b5, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:36.519985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98b8ed-88d5-486d-9846-ff0e16679e26 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:36.533139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 885/1798] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:36 2022] PUT /identity/v3/projects/7f0669b341f64a85bfd989f2886ebf01/users/ea353647acae4f60a405f3438ceda4b5/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:36.544539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ab7dd-aa28-4ea6-b6ad-563c0dae563d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.544838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ab7dd-aa28-4ea6-b6ad-563c0dae563d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.545128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ab7dd-aa28-4ea6-b6ad-563c0dae563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.573149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-835ab7dd-aa28-4ea6-b6ad-563c0dae563d None None] MFA Rules not processed for user `ea353647acae4f60a405f3438ceda4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:36.574390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-835ab7dd-aa28-4ea6-b6ad-563c0dae563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:36.621435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 914/1799] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:36 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:36.626689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b4645-4892-4849-8201-db475baf4cb1 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:36.637642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b4645-4892-4849-8201-db475baf4cb1 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:36.655819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 886/1800] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:36.668800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ab7dd-aa28-4ea6-b6ad-563c0dae563d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:36.700394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:36.716878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e34755-19cb-41f0-8ae5-2d5e4642f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:36.717767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34755-19cb-41f0-8ae5-2d5e4642f484 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.718121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34755-19cb-41f0-8ae5-2d5e4642f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.718326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e34755-19cb-41f0-8ae5-2d5e4642f484 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.719100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e34755-19cb-41f0-8ae5-2d5e4642f484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:36.721107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e34755-19cb-41f0-8ae5-2d5e4642f484 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:36.737162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 915/1801] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:36.738522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e34755-19cb-41f0-8ae5-2d5e4642f484 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:36.738650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ab7dd-aa28-4ea6-b6ad-563c0dae563d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:36.742293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a38f72-c7ef-456c-8b2f-ee9cce913537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:36.742957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a38f72-c7ef-456c-8b2f-ee9cce913537 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.743491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a38f72-c7ef-456c-8b2f-ee9cce913537 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.744301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a38f72-c7ef-456c-8b2f-ee9cce913537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.748871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e34755-19cb-41f0-8ae5-2d5e4642f484 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:36.753670 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2471b-406a-4d8d-bc4f-1803e40205ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:36.754446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2471b-406a-4d8d-bc4f-1803e40205ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.754731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2471b-406a-4d8d-bc4f-1803e40205ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.755037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2471b-406a-4d8d-bc4f-1803e40205ff admin admin] PATH_INFO: `/v3/projects/5528bfb48b534430a96f5b884e7d5506/users/99b07bc2b625411f8243179afa8897d6/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.760593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a38f72-c7ef-456c-8b2f-ee9cce913537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:36.762055 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a38f72-c7ef-456c-8b2f-ee9cce913537 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:36.769727 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:36.770862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2471b-406a-4d8d-bc4f-1803e40205ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5528bfb48b534430a96f5b884e7d5506, user_id=99b07bc2b625411f8243179afa8897d6, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:36.773585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2471b-406a-4d8d-bc4f-1803e40205ff admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:36.775721 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 887/1802] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:36.895433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 916/1803] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:36 2022] PUT /identity/v3/projects/5528bfb48b534430a96f5b884e7d5506/users/99b07bc2b625411f8243179afa8897d6/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:36.901236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a38f72-c7ef-456c-8b2f-ee9cce913537 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:36.911506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a38f72-c7ef-456c-8b2f-ee9cce913537 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:36.967520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5acc4-5053-4298-8170-8a7b3e62f796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:36.968193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5acc4-5053-4298-8170-8a7b3e62f796 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:36.968479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5acc4-5053-4298-8170-8a7b3e62f796 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:36.968757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5acc4-5053-4298-8170-8a7b3e62f796 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:36.969483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5acc4-5053-4298-8170-8a7b3e62f796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:36.971260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5acc4-5053-4298-8170-8a7b3e62f796 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:36.984960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 888/1804] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:36.986420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2471b-406a-4d8d-bc4f-1803e40205ff admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:37.017157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2471b-406a-4d8d-bc4f-1803e40205ff admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:37.029592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b04e9-6529-4986-a250-13eec9c3d40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:37.030498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b04e9-6529-4986-a250-13eec9c3d40d admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:37.030781 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b04e9-6529-4986-a250-13eec9c3d40d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:37.031085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b04e9-6529-4986-a250-13eec9c3d40d admin admin] PATH_INFO: `/v3/projects/5528bfb48b534430a96f5b884e7d5506/users/99b07bc2b625411f8243179afa8897d6/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:37.033310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b04e9-6529-4986-a250-13eec9c3d40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5528bfb48b534430a96f5b884e7d5506, user_id=99b07bc2b625411f8243179afa8897d6, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:37.037841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b04e9-6529-4986-a250-13eec9c3d40d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:37.050152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 917/1805] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:36 2022] PUT /identity/v3/projects/5528bfb48b534430a96f5b884e7d5506/users/99b07bc2b625411f8243179afa8897d6/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:37.062248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a7c7-fe45-482f-bae3-f6a3116c7b1d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:37.066575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a7c7-fe45-482f-bae3-f6a3116c7b1d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:37.066575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9a7c7-fe45-482f-bae3-f6a3116c7b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:37.098614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-60a9a7c7-fe45-482f-bae3-f6a3116c7b1d None None] MFA Rules not processed for user `99b07bc2b625411f8243179afa8897d6`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:37.099645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-60a9a7c7-fe45-482f-bae3-f6a3116c7b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:37.189397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 889/1806] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:37.207109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b04e9-6529-4986-a250-13eec9c3d40d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:37.299119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b04e9-6529-4986-a250-13eec9c3d40d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:37.299119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eab9b-31be-4d37-98bc-80ad445788e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:37.299119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eab9b-31be-4d37-98bc-80ad445788e7 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:37.299119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eab9b-31be-4d37-98bc-80ad445788e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:37.299570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30eab9b-31be-4d37-98bc-80ad445788e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:37.308660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eab9b-31be-4d37-98bc-80ad445788e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:37.310102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30eab9b-31be-4d37-98bc-80ad445788e7 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:37.329468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 918/1807] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:37.770720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:38.072311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9a7c7-fe45-482f-bae3-f6a3116c7b1d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:38.142698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9a7c7-fe45-482f-bae3-f6a3116c7b1d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:38.147889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892ee96-ecf0-47c9-8b63-9c65bf32a899 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea353647acae4f60a405f3438ceda4b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0669b341f64a85bfd989f2886ebf01', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:38.148579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892ee96-ecf0-47c9-8b63-9c65bf32a899 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:38.148871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892ee96-ecf0-47c9-8b63-9c65bf32a899 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:38.149147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892ee96-ecf0-47c9-8b63-9c65bf32a899 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:38.150855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892ee96-ecf0-47c9-8b63-9c65bf32a899 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:38.151377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892ee96-ecf0-47c9-8b63-9c65bf32a899 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:38.153372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892ee96-ecf0-47c9-8b63-9c65bf32a899 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:38.170714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 890/1808] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:01:38.171889 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eab9b-31be-4d37-98bc-80ad445788e7 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:38.184553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30eab9b-31be-4d37-98bc-80ad445788e7 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:38.190210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3da4d-6899-4cd6-af83-21ef7de0955e tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea353647acae4f60a405f3438ceda4b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0669b341f64a85bfd989f2886ebf01', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:38.190892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3da4d-6899-4cd6-af83-21ef7de0955e tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:38.191274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3da4d-6899-4cd6-af83-21ef7de0955e tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:38.191963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3da4d-6899-4cd6-af83-21ef7de0955e tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:38.193576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3da4d-6899-4cd6-af83-21ef7de0955e tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:38.197011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3da4d-6899-4cd6-af83-21ef7de0955e tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:38.253702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:38.292745 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 919/1809] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:38 2022] POST /identity/v3/projects => generated 354 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:38.296760 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892ee96-ecf0-47c9-8b63-9c65bf32a899 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:38.319685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892ee96-ecf0-47c9-8b63-9c65bf32a899 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:38.415891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d6962-5ff8-4bae-bcbc-d905d8372709 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea353647acae4f60a405f3438ceda4b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0669b341f64a85bfd989f2886ebf01', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:38.416573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6962-5ff8-4bae-bcbc-d905d8372709 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:38.416858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6962-5ff8-4bae-bcbc-d905d8372709 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:38.417229 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d6962-5ff8-4bae-bcbc-d905d8372709 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:38.418014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d6962-5ff8-4bae-bcbc-d905d8372709 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:38.418433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d6962-5ff8-4bae-bcbc-d905d8372709 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:38.420094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d6962-5ff8-4bae-bcbc-d905d8372709 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:38.435753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 891/1810] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:38.486950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3da4d-6899-4cd6-af83-21ef7de0955e tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:38.501980 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3da4d-6899-4cd6-af83-21ef7de0955e tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:38.510255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea353647acae4f60a405f3438ceda4b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f0669b341f64a85bfd989f2886ebf01', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:38.511826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:38.512115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:38.512396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] PATH_INFO: `/v3/projects/add93ac4fc9344718ab0d4d89939e6f2` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:38.514324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: Authorizing `identity:delete_project(project_id=add93ac4fc9344718ab0d4d89939e6f2)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:38.516314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:38.668349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add93ac4fc9344718ab0d4d89939e6f2', 'request_id': 'req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:38.689398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add93ac4fc9344718ab0d4d89939e6f2', 'request_id': 'req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:38.701582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add93ac4fc9344718ab0d4d89939e6f2', 'request_id': 'req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:38.765773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d6962-5ff8-4bae-bcbc-d905d8372709 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:38.779781 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] The token cache is being invalidate because project add93ac4fc9344718ab0d4d89939e6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:38.780204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:38.780787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4abdf4bf-bc30-42bf-a3b9-f0744f45d4de tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:38.782440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 920/1811] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:38 2022] DELETE /identity/v3/projects/add93ac4fc9344718ab0d4d89939e6f2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:38.844858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d6962-5ff8-4bae-bcbc-d905d8372709 tempest-VolumeQuotaClassesTest-711332706 tempest-VolumeQuotaClassesTest-711332706-project-admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:38.875168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:38.906858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:38.908080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:38.908369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:38.908643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] PATH_INFO: `/v3/users/2e2caf353b124cda9d049f2245aec906` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:38.909875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2caf353b124cda9d049f2245aec906)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:38.911942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:39.166189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2caf353b124cda9d049f2245aec906'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:39.166850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2caf353b124cda9d049f2245aec906'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:39.167438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2caf353b124cda9d049f2245aec906'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:39.174489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2caf353b124cda9d049f2245aec906'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:39.186427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2caf353b124cda9d049f2245aec906'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:39.334834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 892/1812] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:38 2022] DELETE /identity/v3/users/2e2caf353b124cda9d049f2245aec906 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:39.340040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451871-6e29-48dc-9b0f-7f5167d3f3ce None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:39.340580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451871-6e29-48dc-9b0f-7f5167d3f3ce None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:39.340812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451871-6e29-48dc-9b0f-7f5167d3f3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:39.370539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-50451871-6e29-48dc-9b0f-7f5167d3f3ce None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:39.371891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-50451871-6e29-48dc-9b0f-7f5167d3f3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:39.431308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 921/1813] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:39.441252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:39.442664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:39.502661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8cd42-f1c5-4267-91ce-9f43bc8798ad admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:39.507217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72326ac-6fa1-4b34-89db-3c7b5c561329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:39.507846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72326ac-6fa1-4b34-89db-3c7b5c561329 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:39.508158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72326ac-6fa1-4b34-89db-3c7b5c561329 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:39.508423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72326ac-6fa1-4b34-89db-3c7b5c561329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:39.518472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72326ac-6fa1-4b34-89db-3c7b5c561329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:39.519971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72326ac-6fa1-4b34-89db-3c7b5c561329 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:39.530353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 893/1814] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:39.645690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50451871-6e29-48dc-9b0f-7f5167d3f3ce None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:39.647135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-50451871-6e29-48dc-9b0f-7f5167d3f3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:39.661579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50451871-6e29-48dc-9b0f-7f5167d3f3ce None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:39.666845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:39.667788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:39.668076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:39.668353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] PATH_INFO: `/v3/users/0cf97e8b0bf1412092352139554599b2` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:39.669670 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf97e8b0bf1412092352139554599b2)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:39.671663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:39.902071 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf97e8b0bf1412092352139554599b2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:39.906526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf97e8b0bf1412092352139554599b2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:39.906526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf97e8b0bf1412092352139554599b2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.001979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf97e8b0bf1412092352139554599b2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.009573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72326ac-6fa1-4b34-89db-3c7b5c561329 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:40.011630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3a031fc7-fc25-4d4d-abc0-6bfd2fa4c2ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf97e8b0bf1412092352139554599b2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.011836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c72326ac-6fa1-4b34-89db-3c7b5c561329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:40.028265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72326ac-6fa1-4b34-89db-3c7b5c561329 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:40.035104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:40.035982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:40.036345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:40.036687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] PATH_INFO: `/v3/projects/89d4c307cb764b2eaa5224df0546601a` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:40.038880 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d4c307cb764b2eaa5224df0546601a)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:40.041790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:40.049666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 922/1815] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:39 2022] DELETE /identity/v3/users/0cf97e8b0bf1412092352139554599b2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:40.054007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e046a9f-0f1b-4fbf-9e5e-e8d56ba16e34 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:40.054451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e046a9f-0f1b-4fbf-9e5e-e8d56ba16e34 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:40.054869 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e046a9f-0f1b-4fbf-9e5e-e8d56ba16e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:40.072724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3e046a9f-0f1b-4fbf-9e5e-e8d56ba16e34 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:40.074201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3e046a9f-0f1b-4fbf-9e5e-e8d56ba16e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:40.133971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 923/1816] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:40.143626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e046a9f-0f1b-4fbf-9e5e-e8d56ba16e34 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:40.144992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3e046a9f-0f1b-4fbf-9e5e-e8d56ba16e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:40.191528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d4c307cb764b2eaa5224df0546601a', 'request_id': 'req-60262a7f-c969-448f-89de-c42ce35c8d0b'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.192489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d4c307cb764b2eaa5224df0546601a', 'request_id': 'req-60262a7f-c969-448f-89de-c42ce35c8d0b'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.199452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d4c307cb764b2eaa5224df0546601a', 'request_id': 'req-60262a7f-c969-448f-89de-c42ce35c8d0b'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.203347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e046a9f-0f1b-4fbf-9e5e-e8d56ba16e34 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:40.252242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e42756-8710-43f2-a20d-c24ddd107d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:40.252820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e42756-8710-43f2-a20d-c24ddd107d03 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:40.253101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e42756-8710-43f2-a20d-c24ddd107d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:40.253380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e42756-8710-43f2-a20d-c24ddd107d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:40.311978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e42756-8710-43f2-a20d-c24ddd107d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:40.313433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e42756-8710-43f2-a20d-c24ddd107d03 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:40.323984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 924/1817] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:40.361747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] The token cache is being invalidate because project 89d4c307cb764b2eaa5224df0546601a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:40.362042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.362689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.364413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 894/1818] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:40 2022] DELETE /identity/v3/projects/89d4c307cb764b2eaa5224df0546601a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:40.368777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e42756-8710-43f2-a20d-c24ddd107d03 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:40.370277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d5e42756-8710-43f2-a20d-c24ddd107d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:40.383290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e42756-8710-43f2-a20d-c24ddd107d03 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:40.394072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:40.395593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:40.395936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:40.402069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] PATH_INFO: `/v3/users/99b07bc2b625411f8243179afa8897d6` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:40.402069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b07bc2b625411f8243179afa8897d6)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:40.402069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:40.832283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b07bc2b625411f8243179afa8897d6'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.833065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b07bc2b625411f8243179afa8897d6'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.833690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b07bc2b625411f8243179afa8897d6'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.854874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:40.856638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:40.874021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262a7f-c969-448f-89de-c42ce35c8d0b admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:40.878944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:40.879868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:40.890250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:40.890541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] PATH_INFO: `/v3/projects/218ce759a8014729871b6dcb4e012a58` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:40.891969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=218ce759a8014729871b6dcb4e012a58)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:40.893940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:40.960528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b07bc2b625411f8243179afa8897d6'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.968766 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b07bc2b625411f8243179afa8897d6'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:40.986867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 925/1819] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:40 2022] DELETE /identity/v3/users/99b07bc2b625411f8243179afa8897d6 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:41.008769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218ce759a8014729871b6dcb4e012a58', 'request_id': 'req-3c33df0d-b729-4464-8f52-071b2a45b4dc'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.014204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218ce759a8014729871b6dcb4e012a58', 'request_id': 'req-3c33df0d-b729-4464-8f52-071b2a45b4dc'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.020501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218ce759a8014729871b6dcb4e012a58', 'request_id': 'req-3c33df0d-b729-4464-8f52-071b2a45b4dc'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.103859 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:41.168132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] The token cache is being invalidate because project 218ce759a8014729871b6dcb4e012a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:41.168406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.169069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.170820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 895/1820] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:40 2022] DELETE /identity/v3/projects/218ce759a8014729871b6dcb4e012a58 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:41.174795 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:41.176223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:41.245905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfec8d-83c2-4892-b081-c0d7ff171b3e admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:41.304136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:41.305011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:41.305288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:41.305579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] PATH_INFO: `/v3/users/ea353647acae4f60a405f3438ceda4b5` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:41.307383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea353647acae4f60a405f3438ceda4b5)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:41.309315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:41.545004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:41.546521 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:41.561216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c33df0d-b729-4464-8f52-071b2a45b4dc admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:41.572021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:41.572993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:41.573274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:41.573780 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] PATH_INFO: `/v3/projects/5528bfb48b534430a96f5b884e7d5506` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:41.575337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5528bfb48b534430a96f5b884e7d5506)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:41.586932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:41.588794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea353647acae4f60a405f3438ceda4b5'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.589668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea353647acae4f60a405f3438ceda4b5'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.590274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea353647acae4f60a405f3438ceda4b5'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.687930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea353647acae4f60a405f3438ceda4b5'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.695330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330bf626-ed31-4193-af81-f8c7a06889d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea353647acae4f60a405f3438ceda4b5'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.713242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 926/1821] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:41 2022] DELETE /identity/v3/users/ea353647acae4f60a405f3438ceda4b5 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:41.717210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:41.736262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5528bfb48b534430a96f5b884e7d5506', 'request_id': 'req-28df4194-9c2e-43bd-a28e-3778b83628ba'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.742535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5528bfb48b534430a96f5b884e7d5506', 'request_id': 'req-28df4194-9c2e-43bd-a28e-3778b83628ba'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.751629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5528bfb48b534430a96f5b884e7d5506', 'request_id': 'req-28df4194-9c2e-43bd-a28e-3778b83628ba'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.869081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] The token cache is being invalidate because project 5528bfb48b534430a96f5b884e7d5506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:41.869081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.869081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28df4194-9c2e-43bd-a28e-3778b83628ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:41.869081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 896/1822] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:41 2022] DELETE /identity/v3/projects/5528bfb48b534430a96f5b884e7d5506 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:41.872268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9be98-371e-4dc4-8521-99d658104872 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:41.872557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9be98-371e-4dc4-8521-99d658104872 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:41.872835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9be98-371e-4dc4-8521-99d658104872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:41.891422 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-eef9be98-371e-4dc4-8521-99d658104872 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:41.892645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-eef9be98-371e-4dc4-8521-99d658104872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:41.953818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 927/1823] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:41.961691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673abdfd-4251-403c-80a1-21302671d9a0 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:41.962038 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673abdfd-4251-403c-80a1-21302671d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:41.962323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673abdfd-4251-403c-80a1-21302671d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:41.984296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-673abdfd-4251-403c-80a1-21302671d9a0 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:41.984584 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-673abdfd-4251-403c-80a1-21302671d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:41.992985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 897/1824] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:41.997822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9be98-371e-4dc4-8521-99d658104872 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.008931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9be98-371e-4dc4-8521-99d658104872 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.013764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de9ba5-79ef-4433-9ff3-c1dcca95fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.014763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9ba5-79ef-4433-9ff3-c1dcca95fd6f admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.015160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9ba5-79ef-4433-9ff3-c1dcca95fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.015326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de9ba5-79ef-4433-9ff3-c1dcca95fd6f admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.016105 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de9ba5-79ef-4433-9ff3-c1dcca95fd6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:42.016416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de9ba5-79ef-4433-9ff3-c1dcca95fd6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.018125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de9ba5-79ef-4433-9ff3-c1dcca95fd6f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.030370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 928/1825] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:01:42.034706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673abdfd-4251-403c-80a1-21302671d9a0 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.044876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673abdfd-4251-403c-80a1-21302671d9a0 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.051011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae7959-a110-43a5-85f7-8ae859ac0d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.051757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7959-a110-43a5-85f7-8ae859ac0d45 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.052047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7959-a110-43a5-85f7-8ae859ac0d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.052325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7959-a110-43a5-85f7-8ae859ac0d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.053104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae7959-a110-43a5-85f7-8ae859ac0d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.055435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae7959-a110-43a5-85f7-8ae859ac0d45 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.153495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 898/1826] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:42 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:42.157758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de9ba5-79ef-4433-9ff3-c1dcca95fd6f admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.168470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de9ba5-79ef-4433-9ff3-c1dcca95fd6f admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.226425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4def4-1fd7-4521-8db4-38971193ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.227140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4def4-1fd7-4521-8db4-38971193ee31 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.227495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4def4-1fd7-4521-8db4-38971193ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.228363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4def4-1fd7-4521-8db4-38971193ee31 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.229008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4def4-1fd7-4521-8db4-38971193ee31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.231036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4def4-1fd7-4521-8db4-38971193ee31 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.233298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae7959-a110-43a5-85f7-8ae859ac0d45 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.235272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-daae7959-a110-43a5-85f7-8ae859ac0d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:42.252186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae7959-a110-43a5-85f7-8ae859ac0d45 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.258142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.259185 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.259479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.259746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] PATH_INFO: `/v3/projects/7f0669b341f64a85bfd989f2886ebf01` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.261038 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0669b341f64a85bfd989f2886ebf01)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.263015 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.389334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 929/1827] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:42 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:42.393496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4def4-1fd7-4521-8db4-38971193ee31 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.403877 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4def4-1fd7-4521-8db4-38971193ee31 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.408929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df6b42-5cdd-45d9-9ff1-e7f0fab10ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.409590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df6b42-5cdd-45d9-9ff1-e7f0fab10ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.409970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df6b42-5cdd-45d9-9ff1-e7f0fab10ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.410249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df6b42-5cdd-45d9-9ff1-e7f0fab10ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.411052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df6b42-5cdd-45d9-9ff1-e7f0fab10ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.412696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df6b42-5cdd-45d9-9ff1-e7f0fab10ba6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.426241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 930/1828] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:42.427327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df6b42-5cdd-45d9-9ff1-e7f0fab10ba6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.428475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0669b341f64a85bfd989f2886ebf01', 'request_id': 'req-1796ba19-5cbd-413f-848d-9d76fc1a9c00'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:42.434280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0669b341f64a85bfd989f2886ebf01', 'request_id': 'req-1796ba19-5cbd-413f-848d-9d76fc1a9c00'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:42.438626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df6b42-5cdd-45d9-9ff1-e7f0fab10ba6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.441208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0669b341f64a85bfd989f2886ebf01', 'request_id': 'req-1796ba19-5cbd-413f-848d-9d76fc1a9c00'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:42.486825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:42.495620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16a75f-a89f-4801-aeff-219d29179773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.496434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16a75f-a89f-4801-aeff-219d29179773 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.496730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16a75f-a89f-4801-aeff-219d29179773 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.497006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16a75f-a89f-4801-aeff-219d29179773 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.497785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16a75f-a89f-4801-aeff-219d29179773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.499424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16a75f-a89f-4801-aeff-219d29179773 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.510588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 931/1829] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:42.514950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16a75f-a89f-4801-aeff-219d29179773 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.525945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16a75f-a89f-4801-aeff-219d29179773 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.531172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f0cc7-43d4-4f47-aa2a-2f8f4ffd63cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.532075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f0cc7-43d4-4f47-aa2a-2f8f4ffd63cd admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.532363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f0cc7-43d4-4f47-aa2a-2f8f4ffd63cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.532643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f0cc7-43d4-4f47-aa2a-2f8f4ffd63cd admin admin] PATH_INFO: `/v3/projects/d11460f4b4854a568679c81f2baff68e/users/af3f5362332d46bf9db9f8a358aa07d6/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.536104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] The token cache is being invalidate because project 7f0669b341f64a85bfd989f2886ebf01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:42.536404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:42.538175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1796ba19-5cbd-413f-848d-9d76fc1a9c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:42.539534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 899/1830] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:42 2022] DELETE /identity/v3/projects/7f0669b341f64a85bfd989f2886ebf01 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:42.544399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1e896-d9fc-4dc4-af78-e55f2dee230b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.544690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1e896-d9fc-4dc4-af78-e55f2dee230b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.545028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1e896-d9fc-4dc4-af78-e55f2dee230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.548487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f0cc7-43d4-4f47-aa2a-2f8f4ffd63cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11460f4b4854a568679c81f2baff68e, user_id=af3f5362332d46bf9db9f8a358aa07d6, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.551185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f0cc7-43d4-4f47-aa2a-2f8f4ffd63cd admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.564600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-c1a1e896-d9fc-4dc4-af78-e55f2dee230b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:42.565832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c1a1e896-d9fc-4dc4-af78-e55f2dee230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:42.581187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 900/1831] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:42.584300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ea34-78f9-45ea-a029-65619a93137c None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.584602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ea34-78f9-45ea-a029-65619a93137c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.584887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1ea34-78f9-45ea-a029-65619a93137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.612948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a5c1ea34-78f9-45ea-a029-65619a93137c None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:42.614266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a5c1ea34-78f9-45ea-a029-65619a93137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:42.622917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 901/1832] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:42.629552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 932/1833] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:42 2022] PUT /identity/v3/projects/d11460f4b4854a568679c81f2baff68e/users/af3f5362332d46bf9db9f8a358aa07d6/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:42.630284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ea34-78f9-45ea-a029-65619a93137c None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.641297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1ea34-78f9-45ea-a029-65619a93137c None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.645363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e9923-b525-48a8-857d-11627163a357 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.651639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e9923-b525-48a8-857d-11627163a357 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.651970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e9923-b525-48a8-857d-11627163a357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.684493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-5c1e9923-b525-48a8-857d-11627163a357 None None] MFA Rules not processed for user `af3f5362332d46bf9db9f8a358aa07d6`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:42.685640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5c1e9923-b525-48a8-857d-11627163a357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:42.709439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937705f9-0e8a-4679-bd95-15b2fda031d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.710108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937705f9-0e8a-4679-bd95-15b2fda031d2 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.710393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937705f9-0e8a-4679-bd95-15b2fda031d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.710670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937705f9-0e8a-4679-bd95-15b2fda031d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.711444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937705f9-0e8a-4679-bd95-15b2fda031d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:42.711752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937705f9-0e8a-4679-bd95-15b2fda031d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.715419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937705f9-0e8a-4679-bd95-15b2fda031d2 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.726956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 902/1834] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:42.731274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937705f9-0e8a-4679-bd95-15b2fda031d2 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.741030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937705f9-0e8a-4679-bd95-15b2fda031d2 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.746054 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62115ad-f06e-42b3-aa8b-e2e8a9e50093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.746705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62115ad-f06e-42b3-aa8b-e2e8a9e50093 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.747123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62115ad-f06e-42b3-aa8b-e2e8a9e50093 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.747405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62115ad-f06e-42b3-aa8b-e2e8a9e50093 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.748095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62115ad-f06e-42b3-aa8b-e2e8a9e50093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.750006 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62115ad-f06e-42b3-aa8b-e2e8a9e50093 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.751588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 933/1835] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:42.763750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e9923-b525-48a8-857d-11627163a357 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.765154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5c1e9923-b525-48a8-857d-11627163a357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:42.773613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:42.823032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e9923-b525-48a8-857d-11627163a357 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.826852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b582db9-622f-4f04-b231-4be25ab8d688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.827578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b582db9-622f-4f04-b231-4be25ab8d688 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.827815 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b582db9-622f-4f04-b231-4be25ab8d688 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.828090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b582db9-622f-4f04-b231-4be25ab8d688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.837836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b582db9-622f-4f04-b231-4be25ab8d688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.839352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b582db9-622f-4f04-b231-4be25ab8d688 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.841055 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 903/1836] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:42 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:42.845534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62115ad-f06e-42b3-aa8b-e2e8a9e50093 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.849666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 934/1837] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:42.870838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b582db9-622f-4f04-b231-4be25ab8d688 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:42.872282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9b582db9-622f-4f04-b231-4be25ab8d688 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:42.886835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b582db9-622f-4f04-b231-4be25ab8d688 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.925445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62115ad-f06e-42b3-aa8b-e2e8a9e50093 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:42.931577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb06d25-b5ad-4679-931e-2e2b20ce9e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.932394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb06d25-b5ad-4679-931e-2e2b20ce9e14 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.932870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb06d25-b5ad-4679-931e-2e2b20ce9e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.933137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb06d25-b5ad-4679-931e-2e2b20ce9e14 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.933894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb06d25-b5ad-4679-931e-2e2b20ce9e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.935981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb06d25-b5ad-4679-931e-2e2b20ce9e14 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:42.954385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:42.955288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:42.955569 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:42.955844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] PATH_INFO: `/v3/users/af3f5362332d46bf9db9f8a358aa07d6` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:42.957059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3f5362332d46bf9db9f8a358aa07d6)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:42.959078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:43.058606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 904/1838] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:42 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:43.062627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb06d25-b5ad-4679-931e-2e2b20ce9e14 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:43.073497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb06d25-b5ad-4679-931e-2e2b20ce9e14 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:43.078178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0d6ba-339d-4a3e-8992-315e20a64c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:43.079211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0d6ba-339d-4a3e-8992-315e20a64c72 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.079512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0d6ba-339d-4a3e-8992-315e20a64c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.079787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0d6ba-339d-4a3e-8992-315e20a64c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.080814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0d6ba-339d-4a3e-8992-315e20a64c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:43.082450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0d6ba-339d-4a3e-8992-315e20a64c72 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:43.092920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 905/1839] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:43.096909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0d6ba-339d-4a3e-8992-315e20a64c72 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:43.107289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0d6ba-339d-4a3e-8992-315e20a64c72 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:43.112263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c5863-8eaf-4355-8b11-6495e0957dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:43.112924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5863-8eaf-4355-8b11-6495e0957dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.113205 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5863-8eaf-4355-8b11-6495e0957dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.113482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5863-8eaf-4355-8b11-6495e0957dd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.114295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c5863-8eaf-4355-8b11-6495e0957dd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:43.115934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c5863-8eaf-4355-8b11-6495e0957dd1 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:43.129043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 906/1840] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:43.135796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c5863-8eaf-4355-8b11-6495e0957dd1 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:43.147089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c5863-8eaf-4355-8b11-6495e0957dd1 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:43.152186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41107c16-51cf-4c0c-b4f9-b4fa2ecc5b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:43.153415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107c16-51cf-4c0c-b4f9-b4fa2ecc5b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.153415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107c16-51cf-4c0c-b4f9-b4fa2ecc5b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.153688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41107c16-51cf-4c0c-b4f9-b4fa2ecc5b10 admin admin] PATH_INFO: `/v3/projects/37853235401d466a8228aaa7140e58d2/users/e2f8df76d728498e8c54d875f5901ece/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.174624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41107c16-51cf-4c0c-b4f9-b4fa2ecc5b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37853235401d466a8228aaa7140e58d2, user_id=e2f8df76d728498e8c54d875f5901ece, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:43.177269 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41107c16-51cf-4c0c-b4f9-b4fa2ecc5b10 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:43.184887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3f5362332d46bf9db9f8a358aa07d6'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:43.185548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3f5362332d46bf9db9f8a358aa07d6'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:43.186165 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3f5362332d46bf9db9f8a358aa07d6'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:43.348730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3f5362332d46bf9db9f8a358aa07d6'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:43.358954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d1e38f13-cc24-4f5f-8e59-6e1a7f7c0c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3f5362332d46bf9db9f8a358aa07d6'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:43.364655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 907/1841] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:43 2022] PUT /identity/v3/projects/37853235401d466a8228aaa7140e58d2/users/e2f8df76d728498e8c54d875f5901ece/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:43.377922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0de1c1-12a2-41e9-ba4b-2af7f252b856 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.378512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0de1c1-12a2-41e9-ba4b-2af7f252b856 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.379583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0de1c1-12a2-41e9-ba4b-2af7f252b856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.379983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 935/1842] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:42 2022] DELETE /identity/v3/users/af3f5362332d46bf9db9f8a358aa07d6 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:43.384787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e095e9-fc21-4d93-b837-9d77920eac89 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.385279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e095e9-fc21-4d93-b837-9d77920eac89 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.385568 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e095e9-fc21-4d93-b837-9d77920eac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.403456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f5e095e9-fc21-4d93-b837-9d77920eac89 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:43.404866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f5e095e9-fc21-4d93-b837-9d77920eac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:43.409598 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-7d0de1c1-12a2-41e9-ba4b-2af7f252b856 None None] MFA Rules not processed for user `e2f8df76d728498e8c54d875f5901ece`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:43.410815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7d0de1c1-12a2-41e9-ba4b-2af7f252b856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:43.467474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 936/1843] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:43.476644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 908/1844] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:43.477278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e095e9-fc21-4d93-b837-9d77920eac89 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:43.480427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f5e095e9-fc21-4d93-b837-9d77920eac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:43.481295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0de1c1-12a2-41e9-ba4b-2af7f252b856 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:43.482579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7d0de1c1-12a2-41e9-ba4b-2af7f252b856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:43.496108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0de1c1-12a2-41e9-ba4b-2af7f252b856 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:43.500822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79145c-e205-40fd-9045-1aa95d57166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:43.501477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79145c-e205-40fd-9045-1aa95d57166e admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.501766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79145c-e205-40fd-9045-1aa95d57166e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.502046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79145c-e205-40fd-9045-1aa95d57166e admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.502738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79145c-e205-40fd-9045-1aa95d57166e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:43.504682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79145c-e205-40fd-9045-1aa95d57166e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:43.538114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e095e9-fc21-4d93-b837-9d77920eac89 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:43.542455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f996f7-74f6-447d-b17b-41979c36ee83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:43.543139 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f996f7-74f6-447d-b17b-41979c36ee83 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.543433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f996f7-74f6-447d-b17b-41979c36ee83 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.543711 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f996f7-74f6-447d-b17b-41979c36ee83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.552961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f996f7-74f6-447d-b17b-41979c36ee83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:43.554415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f996f7-74f6-447d-b17b-41979c36ee83 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:43.564735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 937/1845] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:43.596236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 909/1846] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:43 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:43.600345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f996f7-74f6-447d-b17b-41979c36ee83 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:43.610605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f996f7-74f6-447d-b17b-41979c36ee83 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:43.677673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1205158-f395-4386-a0d5-2c235bafd0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:43.678357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1205158-f395-4386-a0d5-2c235bafd0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.678771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1205158-f395-4386-a0d5-2c235bafd0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.679017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1205158-f395-4386-a0d5-2c235bafd0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.679759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1205158-f395-4386-a0d5-2c235bafd0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:43.682269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1205158-f395-4386-a0d5-2c235bafd0c6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:43.709447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:43.776623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 938/1847] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:43 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:43.780329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79145c-e205-40fd-9045-1aa95d57166e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:43.795131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79145c-e205-40fd-9045-1aa95d57166e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:43.800214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3de6d-f81b-4f97-b1ab-71477a49d2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:43.800975 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3de6d-f81b-4f97-b1ab-71477a49d2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.801274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3de6d-f81b-4f97-b1ab-71477a49d2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.801554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3de6d-f81b-4f97-b1ab-71477a49d2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.802291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3de6d-f81b-4f97-b1ab-71477a49d2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:43.803968 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3de6d-f81b-4f97-b1ab-71477a49d2e3 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:43.815897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 910/1848] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:43.820180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1205158-f395-4386-a0d5-2c235bafd0c6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:43.831274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1205158-f395-4386-a0d5-2c235bafd0c6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:43.839166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f6f3-bb58-4ddc-b9cd-d20068537fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:43.839855 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f6f3-bb58-4ddc-b9cd-d20068537fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.840141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f6f3-bb58-4ddc-b9cd-d20068537fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.840523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3f6f3-bb58-4ddc-b9cd-d20068537fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.841248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3f6f3-bb58-4ddc-b9cd-d20068537fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:43.842946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3f6f3-bb58-4ddc-b9cd-d20068537fe0 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:43.857543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 939/1849] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:43.858583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3de6d-f81b-4f97-b1ab-71477a49d2e3 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:43.871406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3de6d-f81b-4f97-b1ab-71477a49d2e3 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:43.877698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558b17d-e21a-474d-922b-b7f235623080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:43.878603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558b17d-e21a-474d-922b-b7f235623080 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.878945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558b17d-e21a-474d-922b-b7f235623080 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.879263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558b17d-e21a-474d-922b-b7f235623080 admin admin] PATH_INFO: `/v3/projects/127a3ea2757743ba8f79c0109acf8060/users/f18d816043a244ddafd337621e3f0a36/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.880701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f6f3-bb58-4ddc-b9cd-d20068537fe0 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:43.883980 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-96a3f6f3-bb58-4ddc-b9cd-d20068537fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:43.886277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:43.901322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558b17d-e21a-474d-922b-b7f235623080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127a3ea2757743ba8f79c0109acf8060, user_id=f18d816043a244ddafd337621e3f0a36, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:43.904262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558b17d-e21a-474d-922b-b7f235623080 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:43.942633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3f6f3-bb58-4ddc-b9cd-d20068537fe0 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:43.956414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8280a2-4216-412d-93e6-06ea0437ba87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:43.957243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8280a2-4216-412d-93e6-06ea0437ba87 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.957527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8280a2-4216-412d-93e6-06ea0437ba87 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.957828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8280a2-4216-412d-93e6-06ea0437ba87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:43.959746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ea8280a2-4216-412d-93e6-06ea0437ba87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:43.974119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 911/1850] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:43 2022] PUT /identity/v3/projects/127a3ea2757743ba8f79c0109acf8060/users/f18d816043a244ddafd337621e3f0a36/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:43.985453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c106ba-02a8-4ae3-b1dc-740a6ed65a27 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:43.985738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c106ba-02a8-4ae3-b1dc-740a6ed65a27 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:43.986000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c106ba-02a8-4ae3-b1dc-740a6ed65a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.018403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-65c106ba-02a8-4ae3-b1dc-740a6ed65a27 None None] MFA Rules not processed for user `f18d816043a244ddafd337621e3f0a36`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:44.020048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-65c106ba-02a8-4ae3-b1dc-740a6ed65a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:44.037079 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8280a2-4216-412d-93e6-06ea0437ba87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.038499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8280a2-4216-412d-93e6-06ea0437ba87 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.057465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 940/1851] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:44.070298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8280a2-4216-412d-93e6-06ea0437ba87 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.076373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ea8280a2-4216-412d-93e6-06ea0437ba87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:44.095713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8280a2-4216-412d-93e6-06ea0437ba87 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.100288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 912/1852] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:44.104886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c106ba-02a8-4ae3-b1dc-740a6ed65a27 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.157596 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.158561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.158848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.159185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] PATH_INFO: `/v3/projects/d11460f4b4854a568679c81f2baff68e` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.160486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11460f4b4854a568679c81f2baff68e)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.162397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.174044 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c106ba-02a8-4ae3-b1dc-740a6ed65a27 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.179509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ff28f-2333-4f2f-9097-71ff3274882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.180229 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ff28f-2333-4f2f-9097-71ff3274882e admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.180578 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ff28f-2333-4f2f-9097-71ff3274882e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.180870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ff28f-2333-4f2f-9097-71ff3274882e admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.181701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ff28f-2333-4f2f-9097-71ff3274882e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.183770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ff28f-2333-4f2f-9097-71ff3274882e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.288716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11460f4b4854a568679c81f2baff68e', 'request_id': 'req-22c948fd-0cf1-4a96-a0db-bb707ad90da5'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:44.294150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11460f4b4854a568679c81f2baff68e', 'request_id': 'req-22c948fd-0cf1-4a96-a0db-bb707ad90da5'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:44.300309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11460f4b4854a568679c81f2baff68e', 'request_id': 'req-22c948fd-0cf1-4a96-a0db-bb707ad90da5'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:44.307612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 913/1853] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:44 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:44.311648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ff28f-2333-4f2f-9097-71ff3274882e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.377240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ff28f-2333-4f2f-9097-71ff3274882e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.379085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] The token cache is being invalidate because project d11460f4b4854a568679c81f2baff68e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:44.379321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:44.383273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63365640-8eb7-4d3d-b9f1-0b8a314660dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.383746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-22c948fd-0cf1-4a96-a0db-bb707ad90da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:44.384589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365640-8eb7-4d3d-b9f1-0b8a314660dc admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.384884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365640-8eb7-4d3d-b9f1-0b8a314660dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.385170 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365640-8eb7-4d3d-b9f1-0b8a314660dc admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.385979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63365640-8eb7-4d3d-b9f1-0b8a314660dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.386350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 941/1854] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:44 2022] DELETE /identity/v3/projects/d11460f4b4854a568679c81f2baff68e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:44.390821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009d33-3ae2-48d4-94da-421fa48d07d8 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.391214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009d33-3ae2-48d4-94da-421fa48d07d8 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.391573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00009d33-3ae2-48d4-94da-421fa48d07d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.391690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63365640-8eb7-4d3d-b9f1-0b8a314660dc admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.410939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-00009d33-3ae2-48d4-94da-421fa48d07d8 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:44.412317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-00009d33-3ae2-48d4-94da-421fa48d07d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:44.420865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 942/1855] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:44.428483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aec0a-9c2d-4659-8e90-a447af4716fc None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.428779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aec0a-9c2d-4659-8e90-a447af4716fc None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.429062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17aec0a-9c2d-4659-8e90-a447af4716fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.448422 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f17aec0a-9c2d-4659-8e90-a447af4716fc None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:44.449882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f17aec0a-9c2d-4659-8e90-a447af4716fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:44.458292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 943/1856] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:44.463054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17aec0a-9c2d-4659-8e90-a447af4716fc None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.471785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 914/1857] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:44 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:44.473070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17aec0a-9c2d-4659-8e90-a447af4716fc None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.479642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63365640-8eb7-4d3d-b9f1-0b8a314660dc admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.480542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762402a5-b6e5-4858-97e6-c50ddfb02780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.481719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762402a5-b6e5-4858-97e6-c50ddfb02780 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.482014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762402a5-b6e5-4858-97e6-c50ddfb02780 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.482298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762402a5-b6e5-4858-97e6-c50ddfb02780 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.482575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-63365640-8eb7-4d3d-b9f1-0b8a314660dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:44.483488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762402a5-b6e5-4858-97e6-c50ddfb02780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:44.483805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762402a5-b6e5-4858-97e6-c50ddfb02780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.485881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762402a5-b6e5-4858-97e6-c50ddfb02780 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.500147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 944/1858] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:01:44.503184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63365640-8eb7-4d3d-b9f1-0b8a314660dc admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.504361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762402a5-b6e5-4858-97e6-c50ddfb02780 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.513870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819d17-8411-44a8-a2fc-e71b6fedcc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.513870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819d17-8411-44a8-a2fc-e71b6fedcc9d admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.513870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819d17-8411-44a8-a2fc-e71b6fedcc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.513870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a819d17-8411-44a8-a2fc-e71b6fedcc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.514198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a819d17-8411-44a8-a2fc-e71b6fedcc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.514198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a819d17-8411-44a8-a2fc-e71b6fedcc9d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.521238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762402a5-b6e5-4858-97e6-c50ddfb02780 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.523804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 915/1859] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:44.527028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53168052-b980-4afe-83a3-b82593b9b606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.527714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168052-b980-4afe-83a3-b82593b9b606 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.528003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168052-b980-4afe-83a3-b82593b9b606 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.528106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819d17-8411-44a8-a2fc-e71b6fedcc9d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.528313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53168052-b980-4afe-83a3-b82593b9b606 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.529017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53168052-b980-4afe-83a3-b82593b9b606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.530946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53168052-b980-4afe-83a3-b82593b9b606 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.537871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a819d17-8411-44a8-a2fc-e71b6fedcc9d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.544380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f6a00-77f5-4341-ba3b-54382145752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.545271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6a00-77f5-4341-ba3b-54382145752d admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.545557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6a00-77f5-4341-ba3b-54382145752d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.545839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f6a00-77f5-4341-ba3b-54382145752d admin admin] PATH_INFO: `/v3/projects/9787166d7e18434cb6cd69aac3cf496c/users/4ccf1cf65b9b40d39917607c8d5eb317/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.564459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f6a00-77f5-4341-ba3b-54382145752d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9787166d7e18434cb6cd69aac3cf496c, user_id=4ccf1cf65b9b40d39917607c8d5eb317, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.567246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f6a00-77f5-4341-ba3b-54382145752d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.677334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 916/1860] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:44 2022] PUT /identity/v3/projects/9787166d7e18434cb6cd69aac3cf496c/users/4ccf1cf65b9b40d39917607c8d5eb317/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:44.681853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f6a00-77f5-4341-ba3b-54382145752d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.683936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 945/1861] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:44 2022] POST /identity/v3/projects => generated 359 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:44.684850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53168052-b980-4afe-83a3-b82593b9b606 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.744543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f6a00-77f5-4341-ba3b-54382145752d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.746369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53168052-b980-4afe-83a3-b82593b9b606 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.749192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb33a4-577f-46bd-a3b4-66a516a28756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.749861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb33a4-577f-46bd-a3b4-66a516a28756 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.750164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb33a4-577f-46bd-a3b4-66a516a28756 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.750422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb33a4-577f-46bd-a3b4-66a516a28756 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.750998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff35cf2-8603-4b70-bb90-a8c08f7aaab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.751227 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb33a4-577f-46bd-a3b4-66a516a28756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.751676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff35cf2-8603-4b70-bb90-a8c08f7aaab5 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.751964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff35cf2-8603-4b70-bb90-a8c08f7aaab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.752240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff35cf2-8603-4b70-bb90-a8c08f7aaab5 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.752777 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb33a4-577f-46bd-a3b4-66a516a28756 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.752945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff35cf2-8603-4b70-bb90-a8c08f7aaab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.754837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff35cf2-8603-4b70-bb90-a8c08f7aaab5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.763210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 917/1862] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:44.767112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb33a4-577f-46bd-a3b4-66a516a28756 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.777444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb33a4-577f-46bd-a3b4-66a516a28756 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.782891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f896cb-8f08-44ec-b8df-7f5cfc536d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.783830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f896cb-8f08-44ec-b8df-7f5cfc536d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.784118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f896cb-8f08-44ec-b8df-7f5cfc536d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.784400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f896cb-8f08-44ec-b8df-7f5cfc536d7f admin admin] PATH_INFO: `/v3/projects/9787166d7e18434cb6cd69aac3cf496c/users/4ccf1cf65b9b40d39917607c8d5eb317/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.786416 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f896cb-8f08-44ec-b8df-7f5cfc536d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9787166d7e18434cb6cd69aac3cf496c, user_id=4ccf1cf65b9b40d39917607c8d5eb317, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.789122 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f896cb-8f08-44ec-b8df-7f5cfc536d7f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.801294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 918/1863] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:44 2022] PUT /identity/v3/projects/9787166d7e18434cb6cd69aac3cf496c/users/4ccf1cf65b9b40d39917607c8d5eb317/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:44.802665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:44.812246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08f5ef-43ea-4f2b-a94d-716106926855 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.812529 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08f5ef-43ea-4f2b-a94d-716106926855 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.812808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08f5ef-43ea-4f2b-a94d-716106926855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.842275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ea08f5ef-43ea-4f2b-a94d-716106926855 None None] MFA Rules not processed for user `4ccf1cf65b9b40d39917607c8d5eb317`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:44.845574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ea08f5ef-43ea-4f2b-a94d-716106926855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:44.874651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 946/1864] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:44 2022] POST /identity/v3/users => generated 280 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:01:44.879115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff35cf2-8603-4b70-bb90-a8c08f7aaab5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.892390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff35cf2-8603-4b70-bb90-a8c08f7aaab5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:44.960092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 919/1865] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:44.971364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08f5ef-43ea-4f2b-a94d-716106926855 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:44.974557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:44.975324 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ea08f5ef-43ea-4f2b-a94d-716106926855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:44.983639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e93f0-d64f-4630-a80f-82fdfd264766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:44.984000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e93f0-d64f-4630-a80f-82fdfd264766 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:44.984286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e93f0-d64f-4630-a80f-82fdfd264766 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:44.984562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e93f0-d64f-4630-a80f-82fdfd264766 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:44.985293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e93f0-d64f-4630-a80f-82fdfd264766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:44.986922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e93f0-d64f-4630-a80f-82fdfd264766 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:44.998761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 947/1866] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:45.002892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e93f0-d64f-4630-a80f-82fdfd264766 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:45.015296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e93f0-d64f-4630-a80f-82fdfd264766 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:45.020098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb22c6-490e-4329-84d5-25116c1ab077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:45.023520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb22c6-490e-4329-84d5-25116c1ab077 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:45.023520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb22c6-490e-4329-84d5-25116c1ab077 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:45.023520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb22c6-490e-4329-84d5-25116c1ab077 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:45.023520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb22c6-490e-4329-84d5-25116c1ab077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:45.024164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb22c6-490e-4329-84d5-25116c1ab077 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:45.036326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 948/1867] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:01:45.041381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb22c6-490e-4329-84d5-25116c1ab077 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:45.047043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08f5ef-43ea-4f2b-a94d-716106926855 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:45.050653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c27aee-50fc-40c3-9448-364fa1674b11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:45.050808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb22c6-490e-4329-84d5-25116c1ab077 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:45.051343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c27aee-50fc-40c3-9448-364fa1674b11 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:45.051624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c27aee-50fc-40c3-9448-364fa1674b11 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:45.051903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c27aee-50fc-40c3-9448-364fa1674b11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:45.055626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef5c2-5944-44ea-a49f-4613e2b83388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:45.056994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef5c2-5944-44ea-a49f-4613e2b83388 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:45.057281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef5c2-5944-44ea-a49f-4613e2b83388 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:45.057568 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef5c2-5944-44ea-a49f-4613e2b83388 admin admin] PATH_INFO: `/v3/projects/96e5ffe6df7049c2989ddc37e94db6cf/users/650dc37dbedf4c95ac686231a6db25d7/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:45.062156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c27aee-50fc-40c3-9448-364fa1674b11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:45.063705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c27aee-50fc-40c3-9448-364fa1674b11 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:45.073575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ef5c2-5944-44ea-a49f-4613e2b83388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e5ffe6df7049c2989ddc37e94db6cf, user_id=650dc37dbedf4c95ac686231a6db25d7, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:45.074592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 920/1868] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:45.077453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ef5c2-5944-44ea-a49f-4613e2b83388 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:45.158444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 949/1869] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:45 2022] PUT /identity/v3/projects/96e5ffe6df7049c2989ddc37e94db6cf/users/650dc37dbedf4c95ac686231a6db25d7/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:01:45.172266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdc556-e13b-490a-a29c-4aa2f405e31d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:45.172557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdc556-e13b-490a-a29c-4aa2f405e31d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:45.172837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdc556-e13b-490a-a29c-4aa2f405e31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:45.200993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f8fdc556-e13b-490a-a29c-4aa2f405e31d None None] MFA Rules not processed for user `650dc37dbedf4c95ac686231a6db25d7`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:45.202244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f8fdc556-e13b-490a-a29c-4aa2f405e31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:45.270327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 921/1870] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:45 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:45.309706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef5c2-5944-44ea-a49f-4613e2b83388 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:45.309706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cc0ef5c2-5944-44ea-a49f-4613e2b83388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:45.363086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef5c2-5944-44ea-a49f-4613e2b83388 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:45.366730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706d01e-1f92-4365-81be-f58e841857c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:45.367445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d01e-1f92-4365-81be-f58e841857c8 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:45.367729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d01e-1f92-4365-81be-f58e841857c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:45.368061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d01e-1f92-4365-81be-f58e841857c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:45.376656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706d01e-1f92-4365-81be-f58e841857c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:45.378072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706d01e-1f92-4365-81be-f58e841857c8 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:45.387000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 950/1871] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:45.401498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdc556-e13b-490a-a29c-4aa2f405e31d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:45.465377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdc556-e13b-490a-a29c-4aa2f405e31d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:45.470084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:45.470960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:45.471270 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:45.471547 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] PATH_INFO: `/v3/users/650dc37dbedf4c95ac686231a6db25d7` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:45.472760 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650dc37dbedf4c95ac686231a6db25d7)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:45.474713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:45.737342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650dc37dbedf4c95ac686231a6db25d7'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:45.738036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650dc37dbedf4c95ac686231a6db25d7'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:45.738650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650dc37dbedf4c95ac686231a6db25d7'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:45.745645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650dc37dbedf4c95ac686231a6db25d7'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:45.757290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650dc37dbedf4c95ac686231a6db25d7'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:45.841267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 922/1872] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:45 2022] DELETE /identity/v3/users/650dc37dbedf4c95ac686231a6db25d7 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:45.845940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5691-2fa9-4a38-b73a-d152b512b48a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:45.846376 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5691-2fa9-4a38-b73a-d152b512b48a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:45.846483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed5691-2fa9-4a38-b73a-d152b512b48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:45.863860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d4ed5691-2fa9-4a38-b73a-d152b512b48a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:45.865058 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d4ed5691-2fa9-4a38-b73a-d152b512b48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:45.925074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 951/1873] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:45.939507 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:45.940915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:45.989792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:46.002238 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc7e3d-88f9-423b-a781-6548ea735eb5 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:46.005799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd9bd2-37ee-46ed-8030-8036699ef97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:46.006450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd9bd2-37ee-46ed-8030-8036699ef97d service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:46.006762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd9bd2-37ee-46ed-8030-8036699ef97d service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:46.007066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd9bd2-37ee-46ed-8030-8036699ef97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:46.020045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd9bd2-37ee-46ed-8030-8036699ef97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:46.025688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd9bd2-37ee-46ed-8030-8036699ef97d service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:46.033533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 923/1874] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:46.233437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:46.303501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed5691-2fa9-4a38-b73a-d152b512b48a None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:46.304887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d4ed5691-2fa9-4a38-b73a-d152b512b48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:46.362990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed5691-2fa9-4a38-b73a-d152b512b48a None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:46.370118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152223-a411-471b-8edf-911696cc543e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:46.370800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152223-a411-471b-8edf-911696cc543e service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:46.371114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152223-a411-471b-8edf-911696cc543e service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:46.376401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152223-a411-471b-8edf-911696cc543e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:46.376401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a3152223-a411-471b-8edf-911696cc543e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:46.433601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3152223-a411-471b-8edf-911696cc543e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:46.434938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3152223-a411-471b-8edf-911696cc543e service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:46.443887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 952/1875] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:46.585969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd9bd2-37ee-46ed-8030-8036699ef97d service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:46.587622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-bbdd9bd2-37ee-46ed-8030-8036699ef97d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:46.603143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd9bd2-37ee-46ed-8030-8036699ef97d service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:46.609198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:46.610081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:46.610400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:46.610635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] PATH_INFO: `/v3/projects/96e5ffe6df7049c2989ddc37e94db6cf` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:46.611899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e5ffe6df7049c2989ddc37e94db6cf)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:46.613995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:46.734196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e5ffe6df7049c2989ddc37e94db6cf', 'request_id': 'req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:46.739992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e5ffe6df7049c2989ddc37e94db6cf', 'request_id': 'req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:46.746481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e5ffe6df7049c2989ddc37e94db6cf', 'request_id': 'req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:46.807355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] The token cache is being invalidate because project 96e5ffe6df7049c2989ddc37e94db6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:46.807598 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:46.808214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f5abef4f-4d95-4e5d-a9d3-8f48e2e80dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:46.809769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 924/1876] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:46 2022] DELETE /identity/v3/projects/96e5ffe6df7049c2989ddc37e94db6cf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:46.815569 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a819f-4df4-483f-a4b6-b209805fe3dc None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:46.815886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a819f-4df4-483f-a4b6-b209805fe3dc None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:46.816163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a819f-4df4-483f-a4b6-b209805fe3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:46.834758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-602a819f-4df4-483f-a4b6-b209805fe3dc None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:46.836016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-602a819f-4df4-483f-a4b6-b209805fe3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:46.901317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 953/1877] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:01:46.910039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62791d87-9562-4034-9c42-4fafc3206eb7 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:46.910387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62791d87-9562-4034-9c42-4fafc3206eb7 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:46.910690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62791d87-9562-4034-9c42-4fafc3206eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:46.931040 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-62791d87-9562-4034-9c42-4fafc3206eb7 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:46.932374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-62791d87-9562-4034-9c42-4fafc3206eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:46.940376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 925/1878] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:46.944632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a819f-4df4-483f-a4b6-b209805fe3dc None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:46.954811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a819f-4df4-483f-a4b6-b209805fe3dc None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:46.959489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f2b84-cef9-4073-8692-4936e9a77d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:46.960164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f2b84-cef9-4073-8692-4936e9a77d03 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:46.960446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f2b84-cef9-4073-8692-4936e9a77d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:46.960713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f2b84-cef9-4073-8692-4936e9a77d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:46.961425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f2b84-cef9-4073-8692-4936e9a77d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:46.962311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f2b84-cef9-4073-8692-4936e9a77d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:46.964051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f2b84-cef9-4073-8692-4936e9a77d03 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:46.980006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 954/1879] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:46.981138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62791d87-9562-4034-9c42-4fafc3206eb7 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:46.994743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62791d87-9562-4034-9c42-4fafc3206eb7 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:47.007688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ece26-20b6-48ce-8a04-09fc355978d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:47.013249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ece26-20b6-48ce-8a04-09fc355978d6 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:47.013249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ece26-20b6-48ce-8a04-09fc355978d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:47.013249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ece26-20b6-48ce-8a04-09fc355978d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:47.013249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ece26-20b6-48ce-8a04-09fc355978d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:47.013249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ece26-20b6-48ce-8a04-09fc355978d6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:47.065240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:47.123002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 926/1880] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:46 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:47.124301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f2b84-cef9-4073-8692-4936e9a77d03 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:47.138489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f2b84-cef9-4073-8692-4936e9a77d03 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:47.195786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a6888-d704-48c3-94af-9f26924a5099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:47.196961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a6888-d704-48c3-94af-9f26924a5099 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:47.197245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a6888-d704-48c3-94af-9f26924a5099 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:47.197552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a6888-d704-48c3-94af-9f26924a5099 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:47.198236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a6888-d704-48c3-94af-9f26924a5099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:47.200229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a6888-d704-48c3-94af-9f26924a5099 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:47.301461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 955/1881] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:47 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:47.305418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ece26-20b6-48ce-8a04-09fc355978d6 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:47.318821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ece26-20b6-48ce-8a04-09fc355978d6 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:47.322308 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:47.326372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48b546-c2c2-4897-ac6e-e0254c793704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:47.327207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b546-c2c2-4897-ac6e-e0254c793704 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:47.327569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b546-c2c2-4897-ac6e-e0254c793704 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:47.327976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48b546-c2c2-4897-ac6e-e0254c793704 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:47.329090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48b546-c2c2-4897-ac6e-e0254c793704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:47.331194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48b546-c2c2-4897-ac6e-e0254c793704 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:47.357414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 927/1882] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:47.358896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a6888-d704-48c3-94af-9f26924a5099 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:47.370312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a6888-d704-48c3-94af-9f26924a5099 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:47.376057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f02f2-6cb2-4a3b-b8c0-d9153ce34fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:47.376864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f02f2-6cb2-4a3b-b8c0-d9153ce34fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:47.377198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f02f2-6cb2-4a3b-b8c0-d9153ce34fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:47.377473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f02f2-6cb2-4a3b-b8c0-d9153ce34fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:47.378209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f02f2-6cb2-4a3b-b8c0-d9153ce34fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:47.380031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f02f2-6cb2-4a3b-b8c0-d9153ce34fe4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:47.392067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 956/1883] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:47.402128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48b546-c2c2-4897-ac6e-e0254c793704 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:47.412838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48b546-c2c2-4897-ac6e-e0254c793704 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:47.417961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e9c91-b470-4ece-b5cd-69c356576e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:47.418735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e9c91-b470-4ece-b5cd-69c356576e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:47.419050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e9c91-b470-4ece-b5cd-69c356576e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:47.419331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e9c91-b470-4ece-b5cd-69c356576e49 admin admin] PATH_INFO: `/v3/projects/8926564d955845ec865c0e7708d0fdb1/users/23d7fcef06544dc985c1fe8abead69db/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:47.434767 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e9c91-b470-4ece-b5cd-69c356576e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8926564d955845ec865c0e7708d0fdb1, user_id=23d7fcef06544dc985c1fe8abead69db, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:47.437532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e9c91-b470-4ece-b5cd-69c356576e49 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:47.499901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 928/1884] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:47 2022] PUT /identity/v3/projects/8926564d955845ec865c0e7708d0fdb1/users/23d7fcef06544dc985c1fe8abead69db/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:47.510709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b82be-cb13-426d-9234-9a3e3a4c5398 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:47.511027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b82be-cb13-426d-9234-9a3e3a4c5398 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:47.511332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b82be-cb13-426d-9234-9a3e3a4c5398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:47.538306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-9f9b82be-cb13-426d-9234-9a3e3a4c5398 None None] MFA Rules not processed for user `23d7fcef06544dc985c1fe8abead69db`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:47.539532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9f9b82be-cb13-426d-9234-9a3e3a4c5398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:47.602203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 957/1885] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:47.613579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e9c91-b470-4ece-b5cd-69c356576e49 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:47.615273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-865e9c91-b470-4ece-b5cd-69c356576e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:47.673249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e9c91-b470-4ece-b5cd-69c356576e49 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:47.677785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a961b-58e1-4b5b-8ada-5ac67bdf1d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:47.678433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a961b-58e1-4b5b-8ada-5ac67bdf1d7e service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:47.678713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a961b-58e1-4b5b-8ada-5ac67bdf1d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:47.679063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a961b-58e1-4b5b-8ada-5ac67bdf1d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:47.688499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a961b-58e1-4b5b-8ada-5ac67bdf1d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:47.689921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a961b-58e1-4b5b-8ada-5ac67bdf1d7e service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:47.699297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 929/1886] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:01:47.723551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b82be-cb13-426d-9234-9a3e3a4c5398 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:47.768449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:47.787167 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b82be-cb13-426d-9234-9a3e3a4c5398 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:47.792589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:47.793456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:47.793737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:47.794012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] PATH_INFO: `/v3/users/23d7fcef06544dc985c1fe8abead69db` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:47.795230 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d7fcef06544dc985c1fe8abead69db)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:47.797140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:47.823789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:48.039227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d7fcef06544dc985c1fe8abead69db'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:48.041016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d7fcef06544dc985c1fe8abead69db'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:48.042309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d7fcef06544dc985c1fe8abead69db'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:48.128696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d7fcef06544dc985c1fe8abead69db'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:48.137348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d7fcef06544dc985c1fe8abead69db'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:48.156949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 958/1887] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:01:47 2022] DELETE /identity/v3/users/23d7fcef06544dc985c1fe8abead69db => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:48.161238 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039e0f-8d99-4531-9f24-52c03ca03e8f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:48.161780 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039e0f-8d99-4531-9f24-52c03ca03e8f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:48.162257 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4039e0f-8d99-4531-9f24-52c03ca03e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:48.182545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f4039e0f-8d99-4531-9f24-52c03ca03e8f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:48.183797 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f4039e0f-8d99-4531-9f24-52c03ca03e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:48.257792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 930/1888] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:48.268213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:48.269715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:48.311358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:48.351941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90fd16-a87c-440a-8400-83ab7ed072c2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:48.356851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e77f12-45ce-4ce4-af6c-d48fc9389466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:48.357689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e77f12-45ce-4ce4-af6c-d48fc9389466 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:48.358027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e77f12-45ce-4ce4-af6c-d48fc9389466 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:48.358307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e77f12-45ce-4ce4-af6c-d48fc9389466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:48.370209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e77f12-45ce-4ce4-af6c-d48fc9389466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:48.371777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e77f12-45ce-4ce4-af6c-d48fc9389466 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:48.382468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 959/1889] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:48.905606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:48.932461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4039e0f-8d99-4531-9f24-52c03ca03e8f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:48.935240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f4039e0f-8d99-4531-9f24-52c03ca03e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:48.956997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4039e0f-8d99-4531-9f24-52c03ca03e8f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:48.963522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:48.964683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:48.965152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:48.965594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] PATH_INFO: `/v3/projects/8926564d955845ec865c0e7708d0fdb1` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:48.976581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8926564d955845ec865c0e7708d0fdb1)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:48.978954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:49.081169 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8926564d955845ec865c0e7708d0fdb1', 'request_id': 'req-6355a772-13d3-4886-8499-5febf4ded385'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:49.087113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8926564d955845ec865c0e7708d0fdb1', 'request_id': 'req-6355a772-13d3-4886-8499-5febf4ded385'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:49.094211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8926564d955845ec865c0e7708d0fdb1', 'request_id': 'req-6355a772-13d3-4886-8499-5febf4ded385'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:49.190153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] The token cache is being invalidate because project 8926564d955845ec865c0e7708d0fdb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:01:49.190455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:49.191293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6355a772-13d3-4886-8499-5febf4ded385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:01:49.192880 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 931/1890] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:01:48 2022] DELETE /identity/v3/projects/8926564d955845ec865c0e7708d0fdb1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:49.198713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ffdf-1962-4008-95ca-ac90d0cbc5e4 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:49.199236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ffdf-1962-4008-95ca-ac90d0cbc5e4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:49.199315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557ffdf-1962-4008-95ca-ac90d0cbc5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:49.219039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b557ffdf-1962-4008-95ca-ac90d0cbc5e4 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:49.220245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b557ffdf-1962-4008-95ca-ac90d0cbc5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:49.279696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 960/1891] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:49.287671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8a60-bd96-4c88-81f6-7f9bcc7d2054 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:49.287895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8a60-bd96-4c88-81f6-7f9bcc7d2054 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:49.288173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8a60-bd96-4c88-81f6-7f9bcc7d2054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:49.311967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-7edf8a60-bd96-4c88-81f6-7f9bcc7d2054 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:49.312299 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:49.313940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7edf8a60-bd96-4c88-81f6-7f9bcc7d2054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:49.323198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 932/1892] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:49.328417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557ffdf-1962-4008-95ca-ac90d0cbc5e4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:49.339788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557ffdf-1962-4008-95ca-ac90d0cbc5e4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:49.344973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818604e-8ec3-4206-83e9-b6f543323cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:49.345671 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818604e-8ec3-4206-83e9-b6f543323cbd admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:49.345956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818604e-8ec3-4206-83e9-b6f543323cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:49.346227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818604e-8ec3-4206-83e9-b6f543323cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:49.347095 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818604e-8ec3-4206-83e9-b6f543323cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:01:49.347582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818604e-8ec3-4206-83e9-b6f543323cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:49.349344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818604e-8ec3-4206-83e9-b6f543323cbd admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:49.362540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 961/1893] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:01:49.367228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf8a60-bd96-4c88-81f6-7f9bcc7d2054 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:49.378386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf8a60-bd96-4c88-81f6-7f9bcc7d2054 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:49.382573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2879-a68c-4ed1-8a1b-f3ebfeb975d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:49.383364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2879-a68c-4ed1-8a1b-f3ebfeb975d0 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:49.383807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2879-a68c-4ed1-8a1b-f3ebfeb975d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:49.384159 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2879-a68c-4ed1-8a1b-f3ebfeb975d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:49.384983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a2879-a68c-4ed1-8a1b-f3ebfeb975d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:49.386940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a2879-a68c-4ed1-8a1b-f3ebfeb975d0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:49.502175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 933/1894] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:01:49 2022] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:49.507533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818604e-8ec3-4206-83e9-b6f543323cbd admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:49.517800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818604e-8ec3-4206-83e9-b6f543323cbd admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:49.581647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd108b-116d-45ad-bd91-9b6448ca6e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:49.582325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd108b-116d-45ad-bd91-9b6448ca6e37 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:49.582610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd108b-116d-45ad-bd91-9b6448ca6e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:49.582886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd108b-116d-45ad-bd91-9b6448ca6e37 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:49.583623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd108b-116d-45ad-bd91-9b6448ca6e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:49.585584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd108b-116d-45ad-bd91-9b6448ca6e37 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:49.690733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 962/1895] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:01:49 2022] POST /identity/v3/users => generated 300 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:01:49.692061 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2879-a68c-4ed1-8a1b-f3ebfeb975d0 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:49.702391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2879-a68c-4ed1-8a1b-f3ebfeb975d0 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:49.708173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100de71-1cea-46a4-a1cd-1f16a42dbf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:49.708864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100de71-1cea-46a4-a1cd-1f16a42dbf7a admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:49.709970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100de71-1cea-46a4-a1cd-1f16a42dbf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:49.709970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100de71-1cea-46a4-a1cd-1f16a42dbf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:49.710281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100de71-1cea-46a4-a1cd-1f16a42dbf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:49.712595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4100de71-1cea-46a4-a1cd-1f16a42dbf7a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:49.723324 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 934/1896] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:49.727237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd108b-116d-45ad-bd91-9b6448ca6e37 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:49.738036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd108b-116d-45ad-bd91-9b6448ca6e37 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:49.742747 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2120d96-a282-4371-bf26-b6e4555e3ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:49.743520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2120d96-a282-4371-bf26-b6e4555e3ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:49.743831 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2120d96-a282-4371-bf26-b6e4555e3ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:49.744114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2120d96-a282-4371-bf26-b6e4555e3ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:49.745027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2120d96-a282-4371-bf26-b6e4555e3ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:49.746529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2120d96-a282-4371-bf26-b6e4555e3ed5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:49.756682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 963/1897] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:01:49.760881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100de71-1cea-46a4-a1cd-1f16a42dbf7a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:49.770861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100de71-1cea-46a4-a1cd-1f16a42dbf7a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:49.776155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e20f74-442d-4fe8-976c-e5087f17c1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:49.777042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e20f74-442d-4fe8-976c-e5087f17c1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:49.777456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e20f74-442d-4fe8-976c-e5087f17c1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:49.777903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e20f74-442d-4fe8-976c-e5087f17c1e4 admin admin] PATH_INFO: `/v3/projects/7e037ca50c0a4b769eef9c5a85debfd2/users/384aa26faef041b19cff5de4da567589/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:49.780109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:49.793304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e20f74-442d-4fe8-976c-e5087f17c1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e037ca50c0a4b769eef9c5a85debfd2, user_id=384aa26faef041b19cff5de4da567589, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:49.796082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e20f74-442d-4fe8-976c-e5087f17c1e4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:49.860443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 935/1898] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:01:49 2022] PUT /identity/v3/projects/7e037ca50c0a4b769eef9c5a85debfd2/users/384aa26faef041b19cff5de4da567589/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:01:49.871668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bea95-1064-4065-8145-04d805e16b64 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:49.871955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bea95-1064-4065-8145-04d805e16b64 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:49.872258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bea95-1064-4065-8145-04d805e16b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:49.898484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ec6bea95-1064-4065-8145-04d805e16b64 None None] MFA Rules not processed for user `384aa26faef041b19cff5de4da567589`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:49.900392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ec6bea95-1064-4065-8145-04d805e16b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:49.965570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 964/1899] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:49.977237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e20f74-442d-4fe8-976c-e5087f17c1e4 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:49.979644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e1e20f74-442d-4fe8-976c-e5087f17c1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:50.037804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e20f74-442d-4fe8-976c-e5087f17c1e4 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:50.041688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d519842-d4f5-42e3-bb59-55603ea83fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:50.042331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d519842-d4f5-42e3-bb59-55603ea83fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:50.042614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d519842-d4f5-42e3-bb59-55603ea83fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:50.042916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d519842-d4f5-42e3-bb59-55603ea83fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:50.051444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d519842-d4f5-42e3-bb59-55603ea83fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:50.052807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d519842-d4f5-42e3-bb59-55603ea83fb5 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:50.061637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 936/1900] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:01:50.128065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:50.315798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:50.886580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:50.997243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:51.270554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:51.405775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:51.491305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:51.583005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:51.613264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:51.698943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:51.727672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:51.886265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:51.914681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:52.017807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:52.093225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:52.345005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:01:53.536914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3147e0-46b4-4e3d-ae91-6403c1f6c4a8 None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:53.544121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3147e0-46b4-4e3d-ae91-6403c1f6c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:53.544121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3147e0-46b4-4e3d-ae91-6403c1f6c4a8 None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:53.544121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 965/1901] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:01:53.548537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f07e-b54e-4400-85e8-9665701af38f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:53.549046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f07e-b54e-4400-85e8-9665701af38f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:53.549150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471f07e-b54e-4400-85e8-9665701af38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:53.576107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8471f07e-b54e-4400-85e8-9665701af38f None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:01:53.577829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8471f07e-b54e-4400-85e8-9665701af38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:53.708366 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 937/1902] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:01:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:01:53.721783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3147e0-46b4-4e3d-ae91-6403c1f6c4a8 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:01:53.723517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-af3147e0-46b4-4e3d-ae91-6403c1f6c4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:01:53.750163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3147e0-46b4-4e3d-ae91-6403c1f6c4a8 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:01:53.756886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682ef30-b08c-4ec0-bb60-85010aa20bc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:01:53.757812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682ef30-b08c-4ec0-bb60-85010aa20bc5 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:01:53.758295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682ef30-b08c-4ec0-bb60-85010aa20bc5 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:01:53.759832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682ef30-b08c-4ec0-bb60-85010aa20bc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:01:53.775676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682ef30-b08c-4ec0-bb60-85010aa20bc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:01:53.777345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682ef30-b08c-4ec0-bb60-85010aa20bc5 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:01:53.789443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 966/1903] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:01:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:03.692713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=81,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:03.784220 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:INSERT=3,keystone:SELECT=45 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:07.953579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f07e-b54e-4400-85e8-9665701af38f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:07.972845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682ef30-b08c-4ec0-bb60-85010aa20bc5 service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:07.986166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682ef30-b08c-4ec0-bb60-85010aa20bc5 service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:07.998138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155d0c0-cce8-4969-89b2-44eddabec49c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:07.999106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d0c0-cce8-4969-89b2-44eddabec49c service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:07.999553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d0c0-cce8-4969-89b2-44eddabec49c service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:07.999988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155d0c0-cce8-4969-89b2-44eddabec49c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:08.006524 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8155d0c0-cce8-4969-89b2-44eddabec49c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:08.100986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155d0c0-cce8-4969-89b2-44eddabec49c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:08.104733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155d0c0-cce8-4969-89b2-44eddabec49c service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:08.108645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471f07e-b54e-4400-85e8-9665701af38f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:08.118429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:08.119131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:08.119408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:08.119699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] PATH_INFO: `/v3/users/384aa26faef041b19cff5de4da567589` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:08.123785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] RBAC: Authorizing `identity:delete_user(user_id=384aa26faef041b19cff5de4da567589)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:08.127344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:08.155675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 967/1904] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:08.446481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384aa26faef041b19cff5de4da567589'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:08.447290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384aa26faef041b19cff5de4da567589'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:08.448088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384aa26faef041b19cff5de4da567589'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:08.493374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384aa26faef041b19cff5de4da567589'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:08.527436 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3224f8fc-7ab9-449c-963a-792390da66da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384aa26faef041b19cff5de4da567589'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:08.666260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 938/1905] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:07 2022] DELETE /identity/v3/users/384aa26faef041b19cff5de4da567589 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:08.668054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8415-834f-4325-ac70-1034313042c0 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:08.668350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8415-834f-4325-ac70-1034313042c0 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:08.668747 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb8415-834f-4325-ac70-1034313042c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:08.859751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-dceb8415-834f-4325-ac70-1034313042c0 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:08.859751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-dceb8415-834f-4325-ac70-1034313042c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:08.861059 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7694fa1-6a10-45d1-9309-3209c6363ba7 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:08.861059 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7694fa1-6a10-45d1-9309-3209c6363ba7 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:08.861059 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7694fa1-6a10-45d1-9309-3209c6363ba7 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:08.861059 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 939/1906] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 14:02:08.861689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 968/1907] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:08.861783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3f62e-57bd-40cc-aedd-2f4058cbf480 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:08.861783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3f62e-57bd-40cc-aedd-2f4058cbf480 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:08.861783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3f62e-57bd-40cc-aedd-2f4058cbf480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:08.862016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb8415-834f-4325-ac70-1034313042c0 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:08.862016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-dceb8415-834f-4325-ac70-1034313042c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:08.862184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-2db3f62e-57bd-40cc-aedd-2f4058cbf480 None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:08.862184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2db3f62e-57bd-40cc-aedd-2f4058cbf480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:08.982342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb8415-834f-4325-ac70-1034313042c0 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:08.997510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6825-07f4-4bc9-acb5-b16b95cbb7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:08.999817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6825-07f4-4bc9-acb5-b16b95cbb7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:09.000150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6825-07f4-4bc9-acb5-b16b95cbb7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:09.000391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6825-07f4-4bc9-acb5-b16b95cbb7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:09.018206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 940/1908] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:02:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:02:09.022052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a6825-07f4-4bc9-acb5-b16b95cbb7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:09.024685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a6825-07f4-4bc9-acb5-b16b95cbb7a3 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:09.038448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 969/1909] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:02:09.058301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3f62e-57bd-40cc-aedd-2f4058cbf480 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:09.063746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2db3f62e-57bd-40cc-aedd-2f4058cbf480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:09.094182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3f62e-57bd-40cc-aedd-2f4058cbf480 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:09.101762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42c8f3-092f-45f5-a1d4-3ed8efd5e329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:09.103384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42c8f3-092f-45f5-a1d4-3ed8efd5e329 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:09.103910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42c8f3-092f-45f5-a1d4-3ed8efd5e329 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:09.104293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42c8f3-092f-45f5-a1d4-3ed8efd5e329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:09.115574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42c8f3-092f-45f5-a1d4-3ed8efd5e329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:09.117440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42c8f3-092f-45f5-a1d4-3ed8efd5e329 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:09.124840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:09.133429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 941/1910] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:09.578199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6825-07f4-4bc9-acb5-b16b95cbb7a3 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:09.580734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8e0a6825-07f4-4bc9-acb5-b16b95cbb7a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:09.600215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6825-07f4-4bc9-acb5-b16b95cbb7a3 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:09.604002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:09.605144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:09.605550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:09.605919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] PATH_INFO: `/v3/projects/7e037ca50c0a4b769eef9c5a85debfd2` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:09.612846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e037ca50c0a4b769eef9c5a85debfd2)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:09.618317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:09.769086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:09.779360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e037ca50c0a4b769eef9c5a85debfd2', 'request_id': 'req-7631c197-860e-4c98-8564-074f92b91d4c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:09.785517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e037ca50c0a4b769eef9c5a85debfd2', 'request_id': 'req-7631c197-860e-4c98-8564-074f92b91d4c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:09.792359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e037ca50c0a4b769eef9c5a85debfd2', 'request_id': 'req-7631c197-860e-4c98-8564-074f92b91d4c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:09.916511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] The token cache is being invalidate because project 7e037ca50c0a4b769eef9c5a85debfd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:09.916827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:09.917586 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7631c197-860e-4c98-8564-074f92b91d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:09.919448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 970/1911] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:09 2022] DELETE /identity/v3/projects/7e037ca50c0a4b769eef9c5a85debfd2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:17.243284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42c8f3-092f-45f5-a1d4-3ed8efd5e329 service nova] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:17.243284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5e42c8f3-092f-45f5-a1d4-3ed8efd5e329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:17.257804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42c8f3-092f-45f5-a1d4-3ed8efd5e329 service nova] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:17.324828 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:17.326115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:17.326731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:17.327307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] PATH_INFO: `/v3/users/e2f8df76d728498e8c54d875f5901ece` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:17.328682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2f8df76d728498e8c54d875f5901ece)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:17.331407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:17.597510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2f8df76d728498e8c54d875f5901ece'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:17.598400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2f8df76d728498e8c54d875f5901ece'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:17.599048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2f8df76d728498e8c54d875f5901ece'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:17.606812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2f8df76d728498e8c54d875f5901ece'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:17.619508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2f8df76d728498e8c54d875f5901ece'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:17.683718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 942/1912] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:17 2022] DELETE /identity/v3/users/e2f8df76d728498e8c54d875f5901ece => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:17.688113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0379b76-0180-4b49-be13-6a92fdeddb6b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:17.688614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0379b76-0180-4b49-be13-6a92fdeddb6b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:17.688699 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0379b76-0180-4b49-be13-6a92fdeddb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:17.707863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b0379b76-0180-4b49-be13-6a92fdeddb6b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:17.709200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b0379b76-0180-4b49-be13-6a92fdeddb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:17.790227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 971/1913] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:17.803675 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:17.805262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:17.875153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc358f-c725-4f24-ae02-6eda39586c58 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:17.878884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46649e12-2f67-44f0-acab-e05564d9a2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:17.879588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649e12-2f67-44f0-acab-e05564d9a2fd service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:17.879870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649e12-2f67-44f0-acab-e05564d9a2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:17.880146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46649e12-2f67-44f0-acab-e05564d9a2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:17.891179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46649e12-2f67-44f0-acab-e05564d9a2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:17.892647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46649e12-2f67-44f0-acab-e05564d9a2fd service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:17.904992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 943/1914] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:18.414602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0379b76-0180-4b49-be13-6a92fdeddb6b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:18.416384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b0379b76-0180-4b49-be13-6a92fdeddb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:18.428899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0379b76-0180-4b49-be13-6a92fdeddb6b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:18.435467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:18.436922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:18.437438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:18.437995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] PATH_INFO: `/v3/projects/37853235401d466a8228aaa7140e58d2` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:18.439312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37853235401d466a8228aaa7140e58d2)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:18.444719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:18.540317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37853235401d466a8228aaa7140e58d2', 'request_id': 'req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:18.549459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37853235401d466a8228aaa7140e58d2', 'request_id': 'req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:18.558069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37853235401d466a8228aaa7140e58d2', 'request_id': 'req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:18.649066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] The token cache is being invalidate because project 37853235401d466a8228aaa7140e58d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:18.651762 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:18.657427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:18.660369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 972/1915] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:18 2022] DELETE /identity/v3/projects/37853235401d466a8228aaa7140e58d2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:18.665418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46649e12-2f67-44f0-acab-e05564d9a2fd service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:18.675748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46649e12-2f67-44f0-acab-e05564d9a2fd service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:18.694495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:18.742373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:18.743832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:18.744094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:18.744370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] PATH_INFO: `/v3/users/f18d816043a244ddafd337621e3f0a36` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:18.745597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18d816043a244ddafd337621e3f0a36)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:18.747581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:18.943336 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18d816043a244ddafd337621e3f0a36'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:18.944233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18d816043a244ddafd337621e3f0a36'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:18.945147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18d816043a244ddafd337621e3f0a36'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:18.959762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18d816043a244ddafd337621e3f0a36'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:18.973369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18d816043a244ddafd337621e3f0a36'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:19.043420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 944/1916] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:18 2022] DELETE /identity/v3/users/f18d816043a244ddafd337621e3f0a36 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:19.466410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:19.467978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:19.482850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9875a9-d8d9-46b1-a5e2-34bf40724a95 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:19.532818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:19.545210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:19.546074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:19.546380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:19.546653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] PATH_INFO: `/v3/projects/127a3ea2757743ba8f79c0109acf8060` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:19.547853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=127a3ea2757743ba8f79c0109acf8060)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:19.549825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:19.702506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127a3ea2757743ba8f79c0109acf8060', 'request_id': 'req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:19.708142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127a3ea2757743ba8f79c0109acf8060', 'request_id': 'req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:19.715154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127a3ea2757743ba8f79c0109acf8060', 'request_id': 'req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:19.861173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] The token cache is being invalidate because project 127a3ea2757743ba8f79c0109acf8060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:19.861427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:19.862045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:19.863710 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 973/1917] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:19 2022] DELETE /identity/v3/projects/127a3ea2757743ba8f79c0109acf8060 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:19.867836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:19.869319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:19.916730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf8d6e-59bc-45b6-8ee2-70fe3f88f9cc admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:19.973037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:19.974017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:19.974222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:19.974524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] PATH_INFO: `/v3/users/4ccf1cf65b9b40d39917607c8d5eb317` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:19.975754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccf1cf65b9b40d39917607c8d5eb317)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:19.978598 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:19.983876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:20.251695 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccf1cf65b9b40d39917607c8d5eb317'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:20.251695 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccf1cf65b9b40d39917607c8d5eb317'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:20.251695 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccf1cf65b9b40d39917607c8d5eb317'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:20.258090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccf1cf65b9b40d39917607c8d5eb317'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:20.271652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d2a2eb22-3bed-473a-887d-3ad36ba83fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccf1cf65b9b40d39917607c8d5eb317'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:20.481947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 945/1918] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:19 2022] DELETE /identity/v3/users/4ccf1cf65b9b40d39917607c8d5eb317 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:20.996599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:20.998071 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:21.038244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b4bd-38ab-4ea6-b7d6-74166c13fd18 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:21.116885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:21.117827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:21.118113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:21.118427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] PATH_INFO: `/v3/projects/9787166d7e18434cb6cd69aac3cf496c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:21.119629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9787166d7e18434cb6cd69aac3cf496c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:21.121632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:21.298824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:21.302021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9787166d7e18434cb6cd69aac3cf496c', 'request_id': 'req-5eeda807-d063-4850-a0f5-e2c31a7c7565'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:21.307520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9787166d7e18434cb6cd69aac3cf496c', 'request_id': 'req-5eeda807-d063-4850-a0f5-e2c31a7c7565'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:21.314479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9787166d7e18434cb6cd69aac3cf496c', 'request_id': 'req-5eeda807-d063-4850-a0f5-e2c31a7c7565'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:21.407067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] The token cache is being invalidate because project 9787166d7e18434cb6cd69aac3cf496c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:21.407435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:21.408339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5eeda807-d063-4850-a0f5-e2c31a7c7565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:21.411893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 974/1919] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:20 2022] DELETE /identity/v3/projects/9787166d7e18434cb6cd69aac3cf496c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:21.416627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f84efa-b5f1-4348-9f6d-715ab338ef05 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:21.417642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f84efa-b5f1-4348-9f6d-715ab338ef05 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:21.417798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f84efa-b5f1-4348-9f6d-715ab338ef05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:21.457904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-53f84efa-b5f1-4348-9f6d-715ab338ef05 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:21.459148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-53f84efa-b5f1-4348-9f6d-715ab338ef05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:21.540674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 946/1920] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:02:21.553713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b9961-0e92-46a2-b246-2078158f421a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:21.554511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b9961-0e92-46a2-b246-2078158f421a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:21.554794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b9961-0e92-46a2-b246-2078158f421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:21.575989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-503b9961-0e92-46a2-b246-2078158f421a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:21.577309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-503b9961-0e92-46a2-b246-2078158f421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:21.585766 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 975/1921] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:21.592859 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f84efa-b5f1-4348-9f6d-715ab338ef05 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:21.603195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f84efa-b5f1-4348-9f6d-715ab338ef05 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:21.608004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cd427-4b29-4035-a8d5-87ca4ddcf09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:21.608664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cd427-4b29-4035-a8d5-87ca4ddcf09a admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:21.608981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cd427-4b29-4035-a8d5-87ca4ddcf09a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:21.609258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cd427-4b29-4035-a8d5-87ca4ddcf09a admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:21.609984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cd427-4b29-4035-a8d5-87ca4ddcf09a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:02:21.610285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cd427-4b29-4035-a8d5-87ca4ddcf09a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:21.611950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cd427-4b29-4035-a8d5-87ca4ddcf09a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:21.624450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 947/1922] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:02:21.629003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b9961-0e92-46a2-b246-2078158f421a None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:21.638932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b9961-0e92-46a2-b246-2078158f421a None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:21.643840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ed74-23cf-4aed-bd25-af71b98811ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:21.644494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ed74-23cf-4aed-bd25-af71b98811ec admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:21.644774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ed74-23cf-4aed-bd25-af71b98811ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:21.645050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699ed74-23cf-4aed-bd25-af71b98811ec admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:21.645835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699ed74-23cf-4aed-bd25-af71b98811ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:21.647797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699ed74-23cf-4aed-bd25-af71b98811ec admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:21.754901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 976/1923] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:21 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:21.759456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cd427-4b29-4035-a8d5-87ca4ddcf09a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:21.769420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cd427-4b29-4035-a8d5-87ca4ddcf09a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:21.825245 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0a830-f65f-451e-ab15-abd9645596c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:21.825845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0a830-f65f-451e-ab15-abd9645596c6 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:21.826129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0a830-f65f-451e-ab15-abd9645596c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:21.826404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0a830-f65f-451e-ab15-abd9645596c6 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:21.827128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0a830-f65f-451e-ab15-abd9645596c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:21.829298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0a830-f65f-451e-ab15-abd9645596c6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:21.835908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:21.908063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 948/1924] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:21 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:21.912169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ed74-23cf-4aed-bd25-af71b98811ec admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:21.922507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699ed74-23cf-4aed-bd25-af71b98811ec admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:21.927377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55dc39-ea30-46c2-871e-bbeea20feeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:21.928039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55dc39-ea30-46c2-871e-bbeea20feeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:21.928346 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55dc39-ea30-46c2-871e-bbeea20feeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:21.928618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55dc39-ea30-46c2-871e-bbeea20feeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:21.929401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55dc39-ea30-46c2-871e-bbeea20feeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:21.932084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55dc39-ea30-46c2-871e-bbeea20feeb6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:21.942086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 977/1925] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:21.946738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0a830-f65f-451e-ab15-abd9645596c6 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:21.956907 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0a830-f65f-451e-ab15-abd9645596c6 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:21.961669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc4c30-e9fb-49ab-a428-f7ffd8a03966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:21.962319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4c30-e9fb-49ab-a428-f7ffd8a03966 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:21.962602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4c30-e9fb-49ab-a428-f7ffd8a03966 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:21.962878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4c30-e9fb-49ab-a428-f7ffd8a03966 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:21.963679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc4c30-e9fb-49ab-a428-f7ffd8a03966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:21.965451 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc4c30-e9fb-49ab-a428-f7ffd8a03966 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:21.976541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 949/1926] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:02:21.980729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55dc39-ea30-46c2-871e-bbeea20feeb6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:21.990623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55dc39-ea30-46c2-871e-bbeea20feeb6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:21.996229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77722653-3a1e-4aa0-bca2-6da1b3ed8f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:21.997095 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77722653-3a1e-4aa0-bca2-6da1b3ed8f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:21.997721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77722653-3a1e-4aa0-bca2-6da1b3ed8f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:21.997721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77722653-3a1e-4aa0-bca2-6da1b3ed8f40 admin admin] PATH_INFO: `/v3/projects/154902f830974c0e80310ef9b3eb94d8/users/d749ef9d914a4f8b80b19fafbbec00db/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:22.012868 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77722653-3a1e-4aa0-bca2-6da1b3ed8f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154902f830974c0e80310ef9b3eb94d8, user_id=d749ef9d914a4f8b80b19fafbbec00db, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:22.015537 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77722653-3a1e-4aa0-bca2-6da1b3ed8f40 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:22.105431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 978/1927] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:21 2022] PUT /identity/v3/projects/154902f830974c0e80310ef9b3eb94d8/users/d749ef9d914a4f8b80b19fafbbec00db/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:22.116837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a50e70-cac8-447b-90f0-d9e674bd87fd None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:22.117130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a50e70-cac8-447b-90f0-d9e674bd87fd None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:22.117406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a50e70-cac8-447b-90f0-d9e674bd87fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:22.144933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-29a50e70-cac8-447b-90f0-d9e674bd87fd None None] MFA Rules not processed for user `d749ef9d914a4f8b80b19fafbbec00db`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:22.146158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-29a50e70-cac8-447b-90f0-d9e674bd87fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:22.215622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 950/1928] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:22.220748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77722653-3a1e-4aa0-bca2-6da1b3ed8f40 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:22.287131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77722653-3a1e-4aa0-bca2-6da1b3ed8f40 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:22.292446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e631e-e245-4d61-8705-85b0cd0ce36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:22.293113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e631e-e245-4d61-8705-85b0cd0ce36d admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:22.293397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e631e-e245-4d61-8705-85b0cd0ce36d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:22.293679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e631e-e245-4d61-8705-85b0cd0ce36d admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:22.294355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e631e-e245-4d61-8705-85b0cd0ce36d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:22.296324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e631e-e245-4d61-8705-85b0cd0ce36d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:22.391115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 979/1929] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:22 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:22.395496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a50e70-cac8-447b-90f0-d9e674bd87fd None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:22.406345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a50e70-cac8-447b-90f0-d9e674bd87fd None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:22.463476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899fafc-cd1a-4d56-8fda-6bca5924a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:22.464178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899fafc-cd1a-4d56-8fda-6bca5924a03a admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:22.464592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899fafc-cd1a-4d56-8fda-6bca5924a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:22.464873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899fafc-cd1a-4d56-8fda-6bca5924a03a admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:22.465577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899fafc-cd1a-4d56-8fda-6bca5924a03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:22.467542 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899fafc-cd1a-4d56-8fda-6bca5924a03a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:22.550491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 951/1930] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:22 2022] POST /identity/v3/users => generated 302 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:22.553898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e631e-e245-4d61-8705-85b0cd0ce36d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:22.566045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e631e-e245-4d61-8705-85b0cd0ce36d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:22.571353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7233ca-be99-4436-bcf8-33d485be89dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:22.572039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7233ca-be99-4436-bcf8-33d485be89dc admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:22.572324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7233ca-be99-4436-bcf8-33d485be89dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:22.572598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7233ca-be99-4436-bcf8-33d485be89dc admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:22.573450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7233ca-be99-4436-bcf8-33d485be89dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:22.575075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7233ca-be99-4436-bcf8-33d485be89dc admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:22.587763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 980/1931] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:22.592235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899fafc-cd1a-4d56-8fda-6bca5924a03a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:22.604150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899fafc-cd1a-4d56-8fda-6bca5924a03a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:22.610081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df597dce-9b11-44ba-9592-707aed3020e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:22.611014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597dce-9b11-44ba-9592-707aed3020e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:22.611305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597dce-9b11-44ba-9592-707aed3020e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:22.611583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597dce-9b11-44ba-9592-707aed3020e6 admin admin] PATH_INFO: `/v3/projects/e15e0228f7224ec38664812a41cac5b4/users/150cbd629dac4aa68ebac6b2af554ab2/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:22.627770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df597dce-9b11-44ba-9592-707aed3020e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15e0228f7224ec38664812a41cac5b4, user_id=150cbd629dac4aa68ebac6b2af554ab2, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:22.630617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df597dce-9b11-44ba-9592-707aed3020e6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:22.734404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 952/1932] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:22 2022] PUT /identity/v3/projects/e15e0228f7224ec38664812a41cac5b4/users/150cbd629dac4aa68ebac6b2af554ab2/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:22.738679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7233ca-be99-4436-bcf8-33d485be89dc admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:22.748919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7233ca-be99-4436-bcf8-33d485be89dc admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:22.792267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:22.806920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a358d-966a-410f-be3a-e2dba39c861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:22.807616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a358d-966a-410f-be3a-e2dba39c861e admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:22.807897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a358d-966a-410f-be3a-e2dba39c861e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:22.808172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a358d-966a-410f-be3a-e2dba39c861e admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:22.808888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a358d-966a-410f-be3a-e2dba39c861e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:22.810470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a358d-966a-410f-be3a-e2dba39c861e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:22.820130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 981/1933] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:22.824604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df597dce-9b11-44ba-9592-707aed3020e6 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:22.835335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df597dce-9b11-44ba-9592-707aed3020e6 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:22.840570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23e0ea-1250-435f-8b21-a3adef0cab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:22.841453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23e0ea-1250-435f-8b21-a3adef0cab67 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:22.841738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23e0ea-1250-435f-8b21-a3adef0cab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:22.842020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23e0ea-1250-435f-8b21-a3adef0cab67 admin admin] PATH_INFO: `/v3/projects/e15e0228f7224ec38664812a41cac5b4/users/150cbd629dac4aa68ebac6b2af554ab2/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:22.844026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23e0ea-1250-435f-8b21-a3adef0cab67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15e0228f7224ec38664812a41cac5b4, user_id=150cbd629dac4aa68ebac6b2af554ab2, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:22.846679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23e0ea-1250-435f-8b21-a3adef0cab67 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:22.858152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 953/1934] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:22 2022] PUT /identity/v3/projects/e15e0228f7224ec38664812a41cac5b4/users/150cbd629dac4aa68ebac6b2af554ab2/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:22.869431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9082a9-ab91-4e6f-9743-bf9be871406c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:22.869722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9082a9-ab91-4e6f-9743-bf9be871406c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:22.870009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9082a9-ab91-4e6f-9743-bf9be871406c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:22.895829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0b9082a9-ab91-4e6f-9743-bf9be871406c None None] MFA Rules not processed for user `150cbd629dac4aa68ebac6b2af554ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:22.897151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0b9082a9-ab91-4e6f-9743-bf9be871406c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:22.966196 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 982/1935] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:22.977992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23e0ea-1250-435f-8b21-a3adef0cab67 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:22.979750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-da23e0ea-1250-435f-8b21-a3adef0cab67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:23.003260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:23.053589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23e0ea-1250-435f-8b21-a3adef0cab67 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:23.057791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decdc37-840e-4638-8e6a-71933fdcb3c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:23.058439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decdc37-840e-4638-8e6a-71933fdcb3c6 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:23.058734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decdc37-840e-4638-8e6a-71933fdcb3c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:23.059037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decdc37-840e-4638-8e6a-71933fdcb3c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:23.068230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decdc37-840e-4638-8e6a-71933fdcb3c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:23.069687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decdc37-840e-4638-8e6a-71933fdcb3c6 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:23.080924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 954/1936] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:23.134303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9082a9-ab91-4e6f-9743-bf9be871406c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:23.144032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9082a9-ab91-4e6f-9743-bf9be871406c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:23.147725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87353a-ae21-409a-b9f7-1ef2b28122ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:23.148374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87353a-ae21-409a-b9f7-1ef2b28122ce service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:23.148721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87353a-ae21-409a-b9f7-1ef2b28122ce service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:23.149623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87353a-ae21-409a-b9f7-1ef2b28122ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:23.206430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87353a-ae21-409a-b9f7-1ef2b28122ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:23.207901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87353a-ae21-409a-b9f7-1ef2b28122ce service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:23.217560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 983/1937] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:27.736218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decdc37-840e-4638-8e6a-71933fdcb3c6 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:27.737654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0decdc37-840e-4638-8e6a-71933fdcb3c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:27.863463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decdc37-840e-4638-8e6a-71933fdcb3c6 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:27.871761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:27.873365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:27.873653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:27.873934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] PATH_INFO: `/v3/users/6f4fd3eb14ba459ba83eb569b135d16e` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:27.875341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4fd3eb14ba459ba83eb569b135d16e)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:27.877435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:28.128857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4fd3eb14ba459ba83eb569b135d16e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:28.129947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4fd3eb14ba459ba83eb569b135d16e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:28.130876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4fd3eb14ba459ba83eb569b135d16e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:28.140692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4fd3eb14ba459ba83eb569b135d16e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:28.161286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4fd3eb14ba459ba83eb569b135d16e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:28.248043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 955/1938] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:27 2022] DELETE /identity/v3/users/6f4fd3eb14ba459ba83eb569b135d16e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:28.252817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ab64-a8bf-4fd1-8277-d610c861059d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:28.253356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ab64-a8bf-4fd1-8277-d610c861059d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:28.253476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ab64-a8bf-4fd1-8277-d610c861059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:28.273044 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0693ab64-a8bf-4fd1-8277-d610c861059d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:28.276088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0693ab64-a8bf-4fd1-8277-d610c861059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:28.352592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 984/1939] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:28.362159 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:28.364409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:28.379710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:28.448441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248863ee-3bd5-47f3-a4eb-b1d328ff63ce admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:28.453079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a261431-ba24-4af9-93fa-ed1405bc64f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:28.453750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a261431-ba24-4af9-93fa-ed1405bc64f0 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:28.454298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a261431-ba24-4af9-93fa-ed1405bc64f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:28.454569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a261431-ba24-4af9-93fa-ed1405bc64f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:28.465266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a261431-ba24-4af9-93fa-ed1405bc64f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:28.466831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a261431-ba24-4af9-93fa-ed1405bc64f0 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:28.478207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 956/1940] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:28.983333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693ab64-a8bf-4fd1-8277-d610c861059d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:28.985266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0693ab64-a8bf-4fd1-8277-d610c861059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:28.995622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:28.999461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693ab64-a8bf-4fd1-8277-d610c861059d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:29.004237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:29.005114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:29.005401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:29.005736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] PATH_INFO: `/v3/projects/06aab54ee43b4d4a8e813fab4def5117` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:29.011559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06aab54ee43b4d4a8e813fab4def5117)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:29.011559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:29.167864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06aab54ee43b4d4a8e813fab4def5117', 'request_id': 'req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.173694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06aab54ee43b4d4a8e813fab4def5117', 'request_id': 'req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.181109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06aab54ee43b4d4a8e813fab4def5117', 'request_id': 'req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.322014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] The token cache is being invalidate because project 06aab54ee43b4d4a8e813fab4def5117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:29.323467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.324760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.333744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 985/1941] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:28 2022] DELETE /identity/v3/projects/06aab54ee43b4d4a8e813fab4def5117 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:29.337213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a261431-ba24-4af9-93fa-ed1405bc64f0 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:29.348698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a261431-ba24-4af9-93fa-ed1405bc64f0 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:29.421708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:29.422622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:29.422901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:29.423204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] PATH_INFO: `/v3/users/769d05f515414860b8573fda641e0bea` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:29.424886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=769d05f515414860b8573fda641e0bea)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:29.427046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:29.556341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:29.557761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:29.571601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6f664-0737-4dc1-bb60-ec2ffde64e1e admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:29.577530 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:29.578645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:29.579203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:29.579483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] PATH_INFO: `/v3/users/d749ef9d914a4f8b80b19fafbbec00db` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:29.581138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d749ef9d914a4f8b80b19fafbbec00db)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:29.583369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:29.745539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769d05f515414860b8573fda641e0bea'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.745539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769d05f515414860b8573fda641e0bea'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.745539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769d05f515414860b8573fda641e0bea'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.750962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769d05f515414860b8573fda641e0bea'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.763066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-a0a4a76a-7063-4db8-9649-dc7095afdc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769d05f515414860b8573fda641e0bea'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.903322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 957/1942] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:29 2022] DELETE /identity/v3/users/769d05f515414860b8573fda641e0bea => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:29.921862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd749ef9d914a4f8b80b19fafbbec00db'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.922521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd749ef9d914a4f8b80b19fafbbec00db'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:29.923161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd749ef9d914a4f8b80b19fafbbec00db'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:30.044875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd749ef9d914a4f8b80b19fafbbec00db'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:30.052445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd749ef9d914a4f8b80b19fafbbec00db'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:30.073669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 986/1943] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:29 2022] DELETE /identity/v3/users/d749ef9d914a4f8b80b19fafbbec00db => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:30.075420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6af39-47af-4c2d-8282-87e0bb99c71b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:30.075719 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6af39-47af-4c2d-8282-87e0bb99c71b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:30.075998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6af39-47af-4c2d-8282-87e0bb99c71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:30.094238 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-81d6af39-47af-4c2d-8282-87e0bb99c71b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:30.095491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-81d6af39-47af-4c2d-8282-87e0bb99c71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:30.101612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:30.159650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 958/1944] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:02:30.169619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:30.171548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:30.257388 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d9ecf-b229-4282-98e4-ee0816438d9b admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:30.261634 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fec1e8-1519-4e94-b7b8-ec16927b5ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:30.262312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fec1e8-1519-4e94-b7b8-ec16927b5ace service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:30.262777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fec1e8-1519-4e94-b7b8-ec16927b5ace service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:30.263080 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fec1e8-1519-4e94-b7b8-ec16927b5ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:30.272940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fec1e8-1519-4e94-b7b8-ec16927b5ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:30.274410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fec1e8-1519-4e94-b7b8-ec16927b5ace service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:30.284863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 987/1945] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:30.358196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6af39-47af-4c2d-8282-87e0bb99c71b None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:30.359808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-81d6af39-47af-4c2d-8282-87e0bb99c71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:30.374170 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6af39-47af-4c2d-8282-87e0bb99c71b None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:30.398182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:30.403888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:30.404119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:30.404406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] PATH_INFO: `/v3/projects/b8668fb7a1b0436e90ec316886b50d8e` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:30.408008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8668fb7a1b0436e90ec316886b50d8e)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:30.410653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:30.548138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8668fb7a1b0436e90ec316886b50d8e', 'request_id': 'req-823eb549-2b39-40c8-8893-6263665513a3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:30.554412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8668fb7a1b0436e90ec316886b50d8e', 'request_id': 'req-823eb549-2b39-40c8-8893-6263665513a3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:30.566829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8668fb7a1b0436e90ec316886b50d8e', 'request_id': 'req-823eb549-2b39-40c8-8893-6263665513a3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:30.640988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] The token cache is being invalidate because project b8668fb7a1b0436e90ec316886b50d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:30.641282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:30.641915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-823eb549-2b39-40c8-8893-6263665513a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:30.643531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 959/1946] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:30 2022] DELETE /identity/v3/projects/b8668fb7a1b0436e90ec316886b50d8e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:30.650269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dace376-20c1-49f5-b86a-b02f3fbdba3d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:30.650269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dace376-20c1-49f5-b86a-b02f3fbdba3d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:30.650814 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dace376-20c1-49f5-b86a-b02f3fbdba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:30.655360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:30.682332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8dace376-20c1-49f5-b86a-b02f3fbdba3d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:30.683582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8dace376-20c1-49f5-b86a-b02f3fbdba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:30.742788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 988/1947] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:30.750692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c745-0781-43f2-97ee-522226717cdc None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:30.751073 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c745-0781-43f2-97ee-522226717cdc None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:30.751431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347c745-0781-43f2-97ee-522226717cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:30.775392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-0347c745-0781-43f2-97ee-522226717cdc None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:30.776593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0347c745-0781-43f2-97ee-522226717cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:30.784827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 960/1948] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:30.789187 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dace376-20c1-49f5-b86a-b02f3fbdba3d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:30.797456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347c745-0781-43f2-97ee-522226717cdc None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:30.800471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dace376-20c1-49f5-b86a-b02f3fbdba3d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:30.803765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0347c745-0781-43f2-97ee-522226717cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:30.805509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd34c95-c811-4072-8bda-f4c6e86d24c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:30.806200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd34c95-c811-4072-8bda-f4c6e86d24c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:30.806464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd34c95-c811-4072-8bda-f4c6e86d24c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:30.806742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd34c95-c811-4072-8bda-f4c6e86d24c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:30.807510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd34c95-c811-4072-8bda-f4c6e86d24c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:02:30.807821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd34c95-c811-4072-8bda-f4c6e86d24c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:30.809581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd34c95-c811-4072-8bda-f4c6e86d24c2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:30.823735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347c745-0781-43f2-97ee-522226717cdc None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:30.830016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:30.830904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:30.831938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:30.832122 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] PATH_INFO: `/v3/projects/154902f830974c0e80310ef9b3eb94d8` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:30.833915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=154902f830974c0e80310ef9b3eb94d8)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:30.836906 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:30.842102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 989/1949] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:02:30.845397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd34c95-c811-4072-8bda-f4c6e86d24c2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:30.858203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd34c95-c811-4072-8bda-f4c6e86d24c2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:30.875962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11340459-209a-464d-b2da-077d8c9a88c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:30.877087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11340459-209a-464d-b2da-077d8c9a88c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:30.877087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11340459-209a-464d-b2da-077d8c9a88c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:30.877351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11340459-209a-464d-b2da-077d8c9a88c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:30.878069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11340459-209a-464d-b2da-077d8c9a88c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:30.880197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11340459-209a-464d-b2da-077d8c9a88c2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:30.984402 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154902f830974c0e80310ef9b3eb94d8', 'request_id': 'req-bd58e00a-7cd0-4cba-ac6b-fc551d460067'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:30.990315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154902f830974c0e80310ef9b3eb94d8', 'request_id': 'req-bd58e00a-7cd0-4cba-ac6b-fc551d460067'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:30.997577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154902f830974c0e80310ef9b3eb94d8', 'request_id': 'req-bd58e00a-7cd0-4cba-ac6b-fc551d460067'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:31.004836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 990/1950] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:30 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:02:31.009614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11340459-209a-464d-b2da-077d8c9a88c2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:31.070273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11340459-209a-464d-b2da-077d8c9a88c2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:31.075592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d717-16d8-481b-af74-0b38127ee8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:31.076431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d717-16d8-481b-af74-0b38127ee8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:31.076716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d717-16d8-481b-af74-0b38127ee8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:31.077023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d717-16d8-481b-af74-0b38127ee8d5 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:31.077703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d717-16d8-481b-af74-0b38127ee8d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:31.079935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d717-16d8-481b-af74-0b38127ee8d5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:31.103593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] The token cache is being invalidate because project 154902f830974c0e80310ef9b3eb94d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:31.110822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:31.110822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:31.110822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 961/1951] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:30 2022] DELETE /identity/v3/projects/154902f830974c0e80310ef9b3eb94d8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:31.110822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:31.111275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:31.124851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:31.176284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58e00a-7cd0-4cba-ac6b-fc551d460067 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:31.183256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 991/1952] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:31 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:31.183401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:31.183401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:31.183401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:31.183664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] PATH_INFO: `/v3/users/150cbd629dac4aa68ebac6b2af554ab2` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:31.184317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d717-16d8-481b-af74-0b38127ee8d5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:31.184817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=150cbd629dac4aa68ebac6b2af554ab2)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:31.185985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a6b3d717-16d8-481b-af74-0b38127ee8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:31.186742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:31.198734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d717-16d8-481b-af74-0b38127ee8d5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:31.203563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6bb3d-d94f-4db6-a293-d7da1c9df010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:31.204493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6bb3d-d94f-4db6-a293-d7da1c9df010 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:31.204779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6bb3d-d94f-4db6-a293-d7da1c9df010 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:31.205203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6bb3d-d94f-4db6-a293-d7da1c9df010 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:31.205926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6bb3d-d94f-4db6-a293-d7da1c9df010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:31.207556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6bb3d-d94f-4db6-a293-d7da1c9df010 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:31.219652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 992/1953] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:31.223607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6bb3d-d94f-4db6-a293-d7da1c9df010 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:31.234129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6bb3d-d94f-4db6-a293-d7da1c9df010 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:31.240219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6e879-e8b5-4fab-a918-17d86ffb05cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:31.240933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6e879-e8b5-4fab-a918-17d86ffb05cf admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:31.241225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6e879-e8b5-4fab-a918-17d86ffb05cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:31.241498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6e879-e8b5-4fab-a918-17d86ffb05cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:31.242222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6e879-e8b5-4fab-a918-17d86ffb05cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:31.244885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6e879-e8b5-4fab-a918-17d86ffb05cf admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:31.255876 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 993/1954] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:02:31.260277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6e879-e8b5-4fab-a918-17d86ffb05cf admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:31.270213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6e879-e8b5-4fab-a918-17d86ffb05cf admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:31.275338 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796c076-2840-4671-bf0d-e998e3d2a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:31.276205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c076-2840-4671-bf0d-e998e3d2a44b admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:31.276505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c076-2840-4671-bf0d-e998e3d2a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:31.276764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796c076-2840-4671-bf0d-e998e3d2a44b admin admin] PATH_INFO: `/v3/projects/575140880cd64e8aa4331792e742eed4/users/13231eddd7554522954a871080db33a0/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:31.293684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796c076-2840-4671-bf0d-e998e3d2a44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=575140880cd64e8aa4331792e742eed4, user_id=13231eddd7554522954a871080db33a0, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:31.296421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796c076-2840-4671-bf0d-e998e3d2a44b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:31.396118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 994/1955] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:31 2022] PUT /identity/v3/projects/575140880cd64e8aa4331792e742eed4/users/13231eddd7554522954a871080db33a0/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:31.406482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a862b7f-45f3-409d-a721-e59ed8f3d128 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:31.406770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a862b7f-45f3-409d-a721-e59ed8f3d128 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:31.407077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a862b7f-45f3-409d-a721-e59ed8f3d128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:31.412638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:31.428758 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150cbd629dac4aa68ebac6b2af554ab2'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:31.429419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150cbd629dac4aa68ebac6b2af554ab2'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:31.430783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150cbd629dac4aa68ebac6b2af554ab2'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:31.435537 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-9a862b7f-45f3-409d-a721-e59ed8f3d128 None None] MFA Rules not processed for user `13231eddd7554522954a871080db33a0`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:31.436755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9a862b7f-45f3-409d-a721-e59ed8f3d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:31.437943 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150cbd629dac4aa68ebac6b2af554ab2'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:31.450498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150cbd629dac4aa68ebac6b2af554ab2'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:31.502393 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 995/1956] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:02:31.506823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a862b7f-45f3-409d-a721-e59ed8f3d128 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:31.508206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9a862b7f-45f3-409d-a721-e59ed8f3d128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:31.568047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 962/1957] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:31 2022] DELETE /identity/v3/users/150cbd629dac4aa68ebac6b2af554ab2 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:31.574930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a862b7f-45f3-409d-a721-e59ed8f3d128 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:31.660208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647705f9-e01d-44ab-a029-5bc582963f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:31.661713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647705f9-e01d-44ab-a029-5bc582963f96 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:31.662209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647705f9-e01d-44ab-a029-5bc582963f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:31.662873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647705f9-e01d-44ab-a029-5bc582963f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:31.663861 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647705f9-e01d-44ab-a029-5bc582963f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:31.666949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647705f9-e01d-44ab-a029-5bc582963f96 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:31.784282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 996/1958] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:31 2022] POST /identity/v3/projects => generated 379 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:02:31.788260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:31.800370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad05dd-bc42-4764-a534-eabb3d3e7e92 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:31.879536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e205cbd-4fd6-4005-b01c-d37f199ab9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:31.880215 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e205cbd-4fd6-4005-b01c-d37f199ab9bd admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:31.880492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e205cbd-4fd6-4005-b01c-d37f199ab9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:31.880768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e205cbd-4fd6-4005-b01c-d37f199ab9bd admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:31.881496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e205cbd-4fd6-4005-b01c-d37f199ab9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:31.883768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e205cbd-4fd6-4005-b01c-d37f199ab9bd admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.033322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 963/1959] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:31 2022] POST /identity/v3/users => generated 290 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:32.037417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647705f9-e01d-44ab-a029-5bc582963f96 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.050898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647705f9-e01d-44ab-a029-5bc582963f96 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.068925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910a9e-8246-4fbc-a4cb-ab51c77725c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.069623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910a9e-8246-4fbc-a4cb-ab51c77725c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.069911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910a9e-8246-4fbc-a4cb-ab51c77725c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.070246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65910a9e-8246-4fbc-a4cb-ab51c77725c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.071815 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65910a9e-8246-4fbc-a4cb-ab51c77725c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.075535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65910a9e-8246-4fbc-a4cb-ab51c77725c2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.093414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 997/1960] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:32.094629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e205cbd-4fd6-4005-b01c-d37f199ab9bd admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.105755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e205cbd-4fd6-4005-b01c-d37f199ab9bd admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.110833 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67dd6-860b-4adf-bce7-7808e1f72212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.111542 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67dd6-860b-4adf-bce7-7808e1f72212 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.111851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67dd6-860b-4adf-bce7-7808e1f72212 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.112111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67dd6-860b-4adf-bce7-7808e1f72212 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.112852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef67dd6-860b-4adf-bce7-7808e1f72212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.114583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef67dd6-860b-4adf-bce7-7808e1f72212 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.127529 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 964/1961] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:32.132002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910a9e-8246-4fbc-a4cb-ab51c77725c2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.143286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65910a9e-8246-4fbc-a4cb-ab51c77725c2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.148034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edae898-8e83-4f91-8bdd-8b0b020adbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.150286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae898-8e83-4f91-8bdd-8b0b020adbbe admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.150622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae898-8e83-4f91-8bdd-8b0b020adbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.150909 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edae898-8e83-4f91-8bdd-8b0b020adbbe admin admin] PATH_INFO: `/v3/projects/1ac09c936b814e95bd67e15c469ed261/users/10b80d2c9a21459f85e82793eff84f22/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.168246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edae898-8e83-4f91-8bdd-8b0b020adbbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac09c936b814e95bd67e15c469ed261, user_id=10b80d2c9a21459f85e82793eff84f22, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.171125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edae898-8e83-4f91-8bdd-8b0b020adbbe admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.215898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67dd6-860b-4adf-bce7-7808e1f72212 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.218043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0ef67dd6-860b-4adf-bce7-7808e1f72212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:32.233751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67dd6-860b-4adf-bce7-7808e1f72212 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.239515 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.240587 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.241209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.241639 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] PATH_INFO: `/v3/projects/e15e0228f7224ec38664812a41cac5b4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.243523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15e0228f7224ec38664812a41cac5b4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.245679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.260978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 998/1962] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:32 2022] PUT /identity/v3/projects/1ac09c936b814e95bd67e15c469ed261/users/10b80d2c9a21459f85e82793eff84f22/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:32.271255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f9ee-1e37-4245-ba70-ff95b44eeadb None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.271833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f9ee-1e37-4245-ba70-ff95b44eeadb None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.272407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877f9ee-1e37-4245-ba70-ff95b44eeadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.288760 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:32.315437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8877f9ee-1e37-4245-ba70-ff95b44eeadb None None] MFA Rules not processed for user `10b80d2c9a21459f85e82793eff84f22`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:32.316692 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8877f9ee-1e37-4245-ba70-ff95b44eeadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:32.386275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:32.390559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 999/1963] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:02:32.394909 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f9ee-1e37-4245-ba70-ff95b44eeadb None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.407086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15e0228f7224ec38664812a41cac5b4', 'request_id': 'req-d4e4063d-5f66-408b-9651-be46479db00d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:32.413436 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15e0228f7224ec38664812a41cac5b4', 'request_id': 'req-d4e4063d-5f66-408b-9651-be46479db00d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:32.421847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15e0228f7224ec38664812a41cac5b4', 'request_id': 'req-d4e4063d-5f66-408b-9651-be46479db00d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:32.463465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877f9ee-1e37-4245-ba70-ff95b44eeadb None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.518552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c4831-ce65-4a18-b886-fec9dd13453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.519252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c4831-ce65-4a18-b886-fec9dd13453c admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.519534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c4831-ce65-4a18-b886-fec9dd13453c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.519806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c4831-ce65-4a18-b886-fec9dd13453c admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.520492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c4831-ce65-4a18-b886-fec9dd13453c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.522390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c4831-ce65-4a18-b886-fec9dd13453c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.535661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] The token cache is being invalidate because project e15e0228f7224ec38664812a41cac5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:32.536472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:32.536764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d4e4063d-5f66-408b-9651-be46479db00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:32.539066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 965/1964] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:32 2022] DELETE /identity/v3/projects/e15e0228f7224ec38664812a41cac5b4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:32.545070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ce040-b53c-4d5c-be28-a38cd255bf7a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.545358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ce040-b53c-4d5c-be28-a38cd255bf7a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.545636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ce040-b53c-4d5c-be28-a38cd255bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.564565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-c98ce040-b53c-4d5c-be28-a38cd255bf7a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:32.565769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c98ce040-b53c-4d5c-be28-a38cd255bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:32.576691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 966/1965] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:32.586237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09781f-085a-477c-89f6-6bd15390f834 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.586525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09781f-085a-477c-89f6-6bd15390f834 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.587062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09781f-085a-477c-89f6-6bd15390f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.606826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-af09781f-085a-477c-89f6-6bd15390f834 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:32.608074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-af09781f-085a-477c-89f6-6bd15390f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:32.610770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1000/1966] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:32 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:32.613116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c4831-ce65-4a18-b886-fec9dd13453c admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.614731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c25c4831-ce65-4a18-b886-fec9dd13453c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:32.675108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 967/1967] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:02:32.679219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09781f-085a-477c-89f6-6bd15390f834 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.688371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c4831-ce65-4a18-b886-fec9dd13453c admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.688940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09781f-085a-477c-89f6-6bd15390f834 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.693723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66a3d-4463-49a7-be7f-a4e631f9fd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.693854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c5ee9-1928-49b8-834a-1f6d2b6cbca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.694387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66a3d-4463-49a7-be7f-a4e631f9fd50 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.694567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c5ee9-1928-49b8-834a-1f6d2b6cbca1 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.694738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66a3d-4463-49a7-be7f-a4e631f9fd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.694833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c5ee9-1928-49b8-834a-1f6d2b6cbca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.695003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66a3d-4463-49a7-be7f-a4e631f9fd50 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.695115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c5ee9-1928-49b8-834a-1f6d2b6cbca1 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.695804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66a3d-4463-49a7-be7f-a4e631f9fd50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:02:32.696037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c5ee9-1928-49b8-834a-1f6d2b6cbca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.696134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66a3d-4463-49a7-be7f-a4e631f9fd50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.697898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66a3d-4463-49a7-be7f-a4e631f9fd50 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.698005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c5ee9-1928-49b8-834a-1f6d2b6cbca1 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.710859 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 968/1968] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:02:32.716041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66a3d-4463-49a7-be7f-a4e631f9fd50 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.726082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66a3d-4463-49a7-be7f-a4e631f9fd50 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.730870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c2793-80f7-4671-893b-f9dd68b09ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.731593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c2793-80f7-4671-893b-f9dd68b09ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.731878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c2793-80f7-4671-893b-f9dd68b09ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.732160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c2793-80f7-4671-893b-f9dd68b09ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.732888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c2793-80f7-4671-893b-f9dd68b09ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.734831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c2793-80f7-4671-893b-f9dd68b09ad4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.790521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1001/1969] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:32 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:02:32.794382 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c5ee9-1928-49b8-834a-1f6d2b6cbca1 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.804307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c5ee9-1928-49b8-834a-1f6d2b6cbca1 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.809331 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49851d2b-4855-43d3-8831-5aa05d9a566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.809996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851d2b-4855-43d3-8831-5aa05d9a566a admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.810565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851d2b-4855-43d3-8831-5aa05d9a566a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.811054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851d2b-4855-43d3-8831-5aa05d9a566a admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.812204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49851d2b-4855-43d3-8831-5aa05d9a566a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.813856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49851d2b-4855-43d3-8831-5aa05d9a566a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.824402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1002/1970] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:32.828551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49851d2b-4855-43d3-8831-5aa05d9a566a admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.839409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49851d2b-4855-43d3-8831-5aa05d9a566a admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.844196 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f972d33-9972-46b6-be72-f6e07fe0f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.845101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f972d33-9972-46b6-be72-f6e07fe0f822 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.845492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f972d33-9972-46b6-be72-f6e07fe0f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.845847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f972d33-9972-46b6-be72-f6e07fe0f822 admin admin] PATH_INFO: `/v3/projects/c0fc8a33e49a406e95a6ee8c42eddceb/users/af20c88ee3c145d8939fc8b8a0704071/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.863874 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f972d33-9972-46b6-be72-f6e07fe0f822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc8a33e49a406e95a6ee8c42eddceb, user_id=af20c88ee3c145d8939fc8b8a0704071, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.867142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 969/1971] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:32 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:02:32.867321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f972d33-9972-46b6-be72-f6e07fe0f822 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.869500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c2793-80f7-4671-893b-f9dd68b09ad4 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:32.930540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c2793-80f7-4671-893b-f9dd68b09ad4 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:32.935475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13da15-12c3-4dcf-9f75-86c0162997e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:32.936143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13da15-12c3-4dcf-9f75-86c0162997e2 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:32.936420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13da15-12c3-4dcf-9f75-86c0162997e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:32.936698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13da15-12c3-4dcf-9f75-86c0162997e2 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:32.937384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13da15-12c3-4dcf-9f75-86c0162997e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:32.939470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13da15-12c3-4dcf-9f75-86c0162997e2 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:32.971786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1003/1972] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:32 2022] PUT /identity/v3/projects/c0fc8a33e49a406e95a6ee8c42eddceb/users/af20c88ee3c145d8939fc8b8a0704071/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:32.975611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f972d33-9972-46b6-be72-f6e07fe0f822 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:33.031142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 970/1973] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:32 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:02:33.035197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13da15-12c3-4dcf-9f75-86c0162997e2 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:33.043818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f972d33-9972-46b6-be72-f6e07fe0f822 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:33.045802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13da15-12c3-4dcf-9f75-86c0162997e2 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:33.048750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56a335-c732-450a-abbc-19fa0dc96ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:33.049666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56a335-c732-450a-abbc-19fa0dc96ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.050002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56a335-c732-450a-abbc-19fa0dc96ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.050286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56a335-c732-450a-abbc-19fa0dc96ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.051065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56a335-c732-450a-abbc-19fa0dc96ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:33.052293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ec642-e490-452f-bad0-5ddabfe10509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:33.052674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56a335-c732-450a-abbc-19fa0dc96ed4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:33.053266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ec642-e490-452f-bad0-5ddabfe10509 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.053729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ec642-e490-452f-bad0-5ddabfe10509 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.054010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ec642-e490-452f-bad0-5ddabfe10509 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.054745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ec642-e490-452f-bad0-5ddabfe10509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:33.056817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ec642-e490-452f-bad0-5ddabfe10509 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:33.064205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1004/1974] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:02:33.071787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 971/1975] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:02:33.073090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56a335-c732-450a-abbc-19fa0dc96ed4 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:33.073271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ec642-e490-452f-bad0-5ddabfe10509 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:33.083889 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56a335-c732-450a-abbc-19fa0dc96ed4 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:33.084073 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ec642-e490-452f-bad0-5ddabfe10509 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:33.089673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001265d-3433-457a-8bae-ce87fdd16f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:33.090129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6074-f3a8-4fcd-af60-47bd59b2c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:33.090736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001265d-3433-457a-8bae-ce87fdd16f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.090852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6074-f3a8-4fcd-af60-47bd59b2c122 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.091121 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6074-f3a8-4fcd-af60-47bd59b2c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.091267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001265d-3433-457a-8bae-ce87fdd16f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.091541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d6074-f3a8-4fcd-af60-47bd59b2c122 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.091647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001265d-3433-457a-8bae-ce87fdd16f32 admin admin] PATH_INFO: `/v3/projects/c0fc8a33e49a406e95a6ee8c42eddceb/users/af20c88ee3c145d8939fc8b8a0704071/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.092309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d6074-f3a8-4fcd-af60-47bd59b2c122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:33.093684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001265d-3433-457a-8bae-ce87fdd16f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0fc8a33e49a406e95a6ee8c42eddceb, user_id=af20c88ee3c145d8939fc8b8a0704071, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:33.093969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d6074-f3a8-4fcd-af60-47bd59b2c122 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:33.096522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001265d-3433-457a-8bae-ce87fdd16f32 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:33.105603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 972/1976] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:02:33.109841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6074-f3a8-4fcd-af60-47bd59b2c122 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:33.120204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1005/1977] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:33 2022] PUT /identity/v3/projects/c0fc8a33e49a406e95a6ee8c42eddceb/users/af20c88ee3c145d8939fc8b8a0704071/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:33.123237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d6074-f3a8-4fcd-af60-47bd59b2c122 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:33.123446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325bbfa-8d3e-4d16-94cc-8cffb9e74a3f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.123943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325bbfa-8d3e-4d16-94cc-8cffb9e74a3f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.124265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325bbfa-8d3e-4d16-94cc-8cffb9e74a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.153213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d325bbfa-8d3e-4d16-94cc-8cffb9e74a3f None None] MFA Rules not processed for user `af20c88ee3c145d8939fc8b8a0704071`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:33.154634 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d325bbfa-8d3e-4d16-94cc-8cffb9e74a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:33.185773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cf61f-eeef-4e24-9917-942e50a903d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:33.186861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cf61f-eeef-4e24-9917-942e50a903d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.187135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cf61f-eeef-4e24-9917-942e50a903d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.187412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cf61f-eeef-4e24-9917-942e50a903d9 admin admin] PATH_INFO: `/v3/projects/e1714faed69e4618b004ae031abe9462/users/713f717d6a1e48a3abbecbc7e0ba8bf8/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.204606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cf61f-eeef-4e24-9917-942e50a903d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1714faed69e4618b004ae031abe9462, user_id=713f717d6a1e48a3abbecbc7e0ba8bf8, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:33.207341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cf61f-eeef-4e24-9917-942e50a903d9 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:33.229489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1006/1978] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:02:33.241552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325bbfa-8d3e-4d16-94cc-8cffb9e74a3f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:33.243932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d325bbfa-8d3e-4d16-94cc-8cffb9e74a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:33.251188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:33.303600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325bbfa-8d3e-4d16-94cc-8cffb9e74a3f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:33.308354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f21d-ac32-48dd-bb53-49d9b14d70e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:33.309022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f21d-ac32-48dd-bb53-49d9b14d70e7 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.309305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f21d-ac32-48dd-bb53-49d9b14d70e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.309579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f21d-ac32-48dd-bb53-49d9b14d70e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.319708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5f21d-ac32-48dd-bb53-49d9b14d70e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:33.322166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5f21d-ac32-48dd-bb53-49d9b14d70e7 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:33.335539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1007/1979] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:33.395993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 973/1980] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:33 2022] PUT /identity/v3/projects/e1714faed69e4618b004ae031abe9462/users/713f717d6a1e48a3abbecbc7e0ba8bf8/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:33.410291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7663a-54ac-42a9-b27a-b6096981dc6e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.410576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7663a-54ac-42a9-b27a-b6096981dc6e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.410853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7663a-54ac-42a9-b27a-b6096981dc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.445469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cf61f-eeef-4e24-9917-942e50a903d9 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:33.477354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b86cf61f-eeef-4e24-9917-942e50a903d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:33.478189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-54a7663a-54ac-42a9-b27a-b6096981dc6e None None] MFA Rules not processed for user `713f717d6a1e48a3abbecbc7e0ba8bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:33.478189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-54a7663a-54ac-42a9-b27a-b6096981dc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:33.566631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cf61f-eeef-4e24-9917-942e50a903d9 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:33.566631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1d51b-cc88-4860-b4b8-0252ee84768e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:33.566631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1d51b-cc88-4860-b4b8-0252ee84768e service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.566631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1d51b-cc88-4860-b4b8-0252ee84768e service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.568085 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1d51b-cc88-4860-b4b8-0252ee84768e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.568085 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-45d1d51b-cc88-4860-b4b8-0252ee84768e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:33.568359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1008/1981] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:33.568359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7663a-54ac-42a9-b27a-b6096981dc6e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:33.661053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7663a-54ac-42a9-b27a-b6096981dc6e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:33.678548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea61463-9b29-40c4-8e41-b4fc3767282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:33.680524 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea61463-9b29-40c4-8e41-b4fc3767282b admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.681667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea61463-9b29-40c4-8e41-b4fc3767282b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.682331 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea61463-9b29-40c4-8e41-b4fc3767282b admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.683985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea61463-9b29-40c4-8e41-b4fc3767282b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:33.692493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1d51b-cc88-4860-b4b8-0252ee84768e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:33.693129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1d51b-cc88-4860-b4b8-0252ee84768e service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:33.696243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea61463-9b29-40c4-8e41-b4fc3767282b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:33.703139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 974/1982] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:02:33.859644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1009/1983] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:33 2022] POST /identity/v3/projects => generated 381 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:33.863648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1d51b-cc88-4860-b4b8-0252ee84768e service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:33.876051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1d51b-cc88-4860-b4b8-0252ee84768e service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:33.942637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da809b-8ab5-4b15-8df1-782db1420448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:33.943666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da809b-8ab5-4b15-8df1-782db1420448 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:33.943666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da809b-8ab5-4b15-8df1-782db1420448 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:33.943949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da809b-8ab5-4b15-8df1-782db1420448 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:33.945098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da809b-8ab5-4b15-8df1-782db1420448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:33.947409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da809b-8ab5-4b15-8df1-782db1420448 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:33.990508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:34.050040 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 975/1984] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:33 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:02:34.051323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea61463-9b29-40c4-8e41-b4fc3767282b admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:34.062797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea61463-9b29-40c4-8e41-b4fc3767282b admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:34.067509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc390306-6ea5-4a48-86b9-bf647ee20d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:34.068245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc390306-6ea5-4a48-86b9-bf647ee20d20 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:34.068524 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc390306-6ea5-4a48-86b9-bf647ee20d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:34.068792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc390306-6ea5-4a48-86b9-bf647ee20d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:34.069543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc390306-6ea5-4a48-86b9-bf647ee20d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:34.071840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc390306-6ea5-4a48-86b9-bf647ee20d20 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:34.083344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1010/1985] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:34.091414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da809b-8ab5-4b15-8df1-782db1420448 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:34.097899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da809b-8ab5-4b15-8df1-782db1420448 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:34.102615 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acbaef-c317-4d68-94b5-0b8b22a46ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:34.103617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acbaef-c317-4d68-94b5-0b8b22a46ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:34.103900 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acbaef-c317-4d68-94b5-0b8b22a46ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:34.104171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1acbaef-c317-4d68-94b5-0b8b22a46ea2 admin admin] PATH_INFO: `/v3/projects/246f29e4c2bf4ec38fc9a902dd964f4e/users/3914418bed054dc583d128251a65005c/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:34.122040 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acbaef-c317-4d68-94b5-0b8b22a46ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246f29e4c2bf4ec38fc9a902dd964f4e, user_id=3914418bed054dc583d128251a65005c, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:34.125875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1acbaef-c317-4d68-94b5-0b8b22a46ea2 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:34.228855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 976/1986] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:34 2022] PUT /identity/v3/projects/246f29e4c2bf4ec38fc9a902dd964f4e/users/3914418bed054dc583d128251a65005c/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:34.233102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc390306-6ea5-4a48-86b9-bf647ee20d20 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:34.243819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc390306-6ea5-4a48-86b9-bf647ee20d20 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:34.290128 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:34.305864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ce934-b532-4bd5-b8ed-c48b2abc0020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:34.307058 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ce934-b532-4bd5-b8ed-c48b2abc0020 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:34.307350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ce934-b532-4bd5-b8ed-c48b2abc0020 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:34.307626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ce934-b532-4bd5-b8ed-c48b2abc0020 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:34.308365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ce934-b532-4bd5-b8ed-c48b2abc0020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:34.310105 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ce934-b532-4bd5-b8ed-c48b2abc0020 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:34.323491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1011/1987] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:34.324705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acbaef-c317-4d68-94b5-0b8b22a46ea2 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:34.335477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1acbaef-c317-4d68-94b5-0b8b22a46ea2 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:34.340261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140caad-8ebb-435c-8ce6-e1e0d690b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:34.341137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140caad-8ebb-435c-8ce6-e1e0d690b3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:34.341415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140caad-8ebb-435c-8ce6-e1e0d690b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:34.341691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140caad-8ebb-435c-8ce6-e1e0d690b3bc admin admin] PATH_INFO: `/v3/projects/246f29e4c2bf4ec38fc9a902dd964f4e/users/3914418bed054dc583d128251a65005c/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:34.343797 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140caad-8ebb-435c-8ce6-e1e0d690b3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=246f29e4c2bf4ec38fc9a902dd964f4e, user_id=3914418bed054dc583d128251a65005c, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:34.346428 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140caad-8ebb-435c-8ce6-e1e0d690b3bc admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:34.358204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 977/1988] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:34 2022] PUT /identity/v3/projects/246f29e4c2bf4ec38fc9a902dd964f4e/users/3914418bed054dc583d128251a65005c/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:34.369997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1e65-1a43-490c-b6ed-24d2cb3d5a58 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:34.372372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1e65-1a43-490c-b6ed-24d2cb3d5a58 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:34.372372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff1e65-1a43-490c-b6ed-24d2cb3d5a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:34.398392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-23ff1e65-1a43-490c-b6ed-24d2cb3d5a58 None None] MFA Rules not processed for user `3914418bed054dc583d128251a65005c`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:34.399680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-23ff1e65-1a43-490c-b6ed-24d2cb3d5a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:34.486108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1012/1989] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:34.498407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140caad-8ebb-435c-8ce6-e1e0d690b3bc admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:34.556973 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140caad-8ebb-435c-8ce6-e1e0d690b3bc admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:34.560655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2da0be-cd23-4be1-a258-86605cf51d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:34.561297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da0be-cd23-4be1-a258-86605cf51d21 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:34.561577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da0be-cd23-4be1-a258-86605cf51d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:34.561852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2da0be-cd23-4be1-a258-86605cf51d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:34.571535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2da0be-cd23-4be1-a258-86605cf51d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:34.573005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2da0be-cd23-4be1-a258-86605cf51d21 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:34.583971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 978/1990] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:34.734011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:34.770507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1e65-1a43-490c-b6ed-24d2cb3d5a58 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:34.783459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff1e65-1a43-490c-b6ed-24d2cb3d5a58 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:34.795464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa5acc-b1f3-4e1e-8186-2fcebd8d322f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:34.796261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5acc-b1f3-4e1e-8186-2fcebd8d322f service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:34.796651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5acc-b1f3-4e1e-8186-2fcebd8d322f service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:34.797035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa5acc-b1f3-4e1e-8186-2fcebd8d322f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:34.828056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:34.879833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa5acc-b1f3-4e1e-8186-2fcebd8d322f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:34.881421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa5acc-b1f3-4e1e-8186-2fcebd8d322f service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:34.893123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1013/1991] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:34.914792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:35.489081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2da0be-cd23-4be1-a258-86605cf51d21 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:35.555745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2da0be-cd23-4be1-a258-86605cf51d21 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:35.560389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:35.561254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:35.561530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:35.561802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] PATH_INFO: `/v3/users/713f717d6a1e48a3abbecbc7e0ba8bf8` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:35.562987 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713f717d6a1e48a3abbecbc7e0ba8bf8)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:35.565612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:35.658316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:35.766459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713f717d6a1e48a3abbecbc7e0ba8bf8'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:35.767142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713f717d6a1e48a3abbecbc7e0ba8bf8'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:35.767744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713f717d6a1e48a3abbecbc7e0ba8bf8'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:35.774795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713f717d6a1e48a3abbecbc7e0ba8bf8'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:35.787738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713f717d6a1e48a3abbecbc7e0ba8bf8'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:35.865863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 979/1992] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:35 2022] DELETE /identity/v3/users/713f717d6a1e48a3abbecbc7e0ba8bf8 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:35.868125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8567a-c5d6-43ab-b054-ec3497a14596 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:35.868578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8567a-c5d6-43ab-b054-ec3497a14596 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:35.868712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8567a-c5d6-43ab-b054-ec3497a14596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:35.889006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-6ed8567a-c5d6-43ab-b054-ec3497a14596 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:35.889006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6ed8567a-c5d6-43ab-b054-ec3497a14596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:35.948369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1014/1993] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:02:35.958621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:35.960075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:36.022647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f1915-5667-4c5f-87ef-23b6234fdc07 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:36.026713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19f5bd-a68a-4818-b6d2-11428b422c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:36.027403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19f5bd-a68a-4818-b6d2-11428b422c0b service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:36.027689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19f5bd-a68a-4818-b6d2-11428b422c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:36.028019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19f5bd-a68a-4818-b6d2-11428b422c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:36.037616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19f5bd-a68a-4818-b6d2-11428b422c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:36.039101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19f5bd-a68a-4818-b6d2-11428b422c0b service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:36.050115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 980/1994] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:36.476496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8567a-c5d6-43ab-b054-ec3497a14596 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:36.477885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6ed8567a-c5d6-43ab-b054-ec3497a14596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:36.489957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8567a-c5d6-43ab-b054-ec3497a14596 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:36.494504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:36.495408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:36.495694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:36.495979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] PATH_INFO: `/v3/projects/e1714faed69e4618b004ae031abe9462` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:36.497156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1714faed69e4618b004ae031abe9462)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:36.499126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:36.652274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1714faed69e4618b004ae031abe9462', 'request_id': 'req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:36.657800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1714faed69e4618b004ae031abe9462', 'request_id': 'req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:36.664024 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1714faed69e4618b004ae031abe9462', 'request_id': 'req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:36.741205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] The token cache is being invalidate because project e1714faed69e4618b004ae031abe9462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:36.741407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:36.742023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:36.743647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1015/1995] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:36 2022] DELETE /identity/v3/projects/e1714faed69e4618b004ae031abe9462 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:36.748066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19f5bd-a68a-4818-b6d2-11428b422c0b service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:36.757653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19f5bd-a68a-4818-b6d2-11428b422c0b service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:36.824694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:36.825596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:36.825874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:36.826146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] PATH_INFO: `/v3/users/3914418bed054dc583d128251a65005c` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:36.827348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3914418bed054dc583d128251a65005c)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:36.829537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:36.843377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:37.118224 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3914418bed054dc583d128251a65005c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:37.118895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3914418bed054dc583d128251a65005c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:37.119541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3914418bed054dc583d128251a65005c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:37.127326 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3914418bed054dc583d128251a65005c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:37.139754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b4970ef9-185d-4336-b911-4121ae67d7a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3914418bed054dc583d128251a65005c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:37.247725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 981/1996] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:36 2022] DELETE /identity/v3/users/3914418bed054dc583d128251a65005c => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:37.757197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:37.759363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:37.774894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824cc11-4fd2-46e5-bfce-9d6fd3c8cffb admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:37.836070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:37.836935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:37.837215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:37.837492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] PATH_INFO: `/v3/projects/246f29e4c2bf4ec38fc9a902dd964f4e` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:37.838707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=246f29e4c2bf4ec38fc9a902dd964f4e)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:37.840734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:37.957264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:37.977116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246f29e4c2bf4ec38fc9a902dd964f4e', 'request_id': 'req-3d624be9-d3ca-4091-b5f3-22b13e70beb9'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:37.983448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246f29e4c2bf4ec38fc9a902dd964f4e', 'request_id': 'req-3d624be9-d3ca-4091-b5f3-22b13e70beb9'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:37.989977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246f29e4c2bf4ec38fc9a902dd964f4e', 'request_id': 'req-3d624be9-d3ca-4091-b5f3-22b13e70beb9'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:38.064015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] The token cache is being invalidate because project 246f29e4c2bf4ec38fc9a902dd964f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:38.064300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:38.064916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3d624be9-d3ca-4091-b5f3-22b13e70beb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:38.066467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1016/1997] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:37 2022] DELETE /identity/v3/projects/246f29e4c2bf4ec38fc9a902dd964f4e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:38.071397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cccf26-c873-4f54-9fd0-e88e25af46b5 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:38.071896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cccf26-c873-4f54-9fd0-e88e25af46b5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:38.072001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cccf26-c873-4f54-9fd0-e88e25af46b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:38.089592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-81cccf26-c873-4f54-9fd0-e88e25af46b5 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:38.090864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-81cccf26-c873-4f54-9fd0-e88e25af46b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:38.148950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 982/1998] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:38.156713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca98d1b-9b39-49c7-aa47-edfb3e9e0f24 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:38.157569 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca98d1b-9b39-49c7-aa47-edfb3e9e0f24 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:38.157569 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca98d1b-9b39-49c7-aa47-edfb3e9e0f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:38.175654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-cca98d1b-9b39-49c7-aa47-edfb3e9e0f24 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:38.176849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cca98d1b-9b39-49c7-aa47-edfb3e9e0f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:38.185676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1017/1999] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:38.189957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cccf26-c873-4f54-9fd0-e88e25af46b5 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:38.199700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cccf26-c873-4f54-9fd0-e88e25af46b5 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:38.204572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df0220-999d-473d-b912-443067b27e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:38.205281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df0220-999d-473d-b912-443067b27e2e admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:38.205502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df0220-999d-473d-b912-443067b27e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:38.205777 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df0220-999d-473d-b912-443067b27e2e admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:38.206540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df0220-999d-473d-b912-443067b27e2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:02:38.206855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df0220-999d-473d-b912-443067b27e2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:38.208490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df0220-999d-473d-b912-443067b27e2e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:38.223953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 983/2000] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:02:38.225117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca98d1b-9b39-49c7-aa47-edfb3e9e0f24 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:38.235106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca98d1b-9b39-49c7-aa47-edfb3e9e0f24 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:38.239761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019afaf8-3d96-4337-b844-dbe610a58a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:38.240415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019afaf8-3d96-4337-b844-dbe610a58a74 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:38.240693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019afaf8-3d96-4337-b844-dbe610a58a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:38.240964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019afaf8-3d96-4337-b844-dbe610a58a74 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:38.241647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019afaf8-3d96-4337-b844-dbe610a58a74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:38.243589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019afaf8-3d96-4337-b844-dbe610a58a74 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:38.366896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1018/2001] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:38 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:38.371096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df0220-999d-473d-b912-443067b27e2e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:38.381214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df0220-999d-473d-b912-443067b27e2e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:38.441447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323c269-8189-4585-a111-2165cd642d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:38.442122 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323c269-8189-4585-a111-2165cd642d81 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:38.442409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323c269-8189-4585-a111-2165cd642d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:38.442687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323c269-8189-4585-a111-2165cd642d81 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:38.443428 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323c269-8189-4585-a111-2165cd642d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:38.445365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323c269-8189-4585-a111-2165cd642d81 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:38.553533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 984/2002] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:38 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:02:38.557436 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019afaf8-3d96-4337-b844-dbe610a58a74 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:38.568087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019afaf8-3d96-4337-b844-dbe610a58a74 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:38.572869 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cce44-9852-400b-bbd9-13890df7a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:38.573539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cce44-9852-400b-bbd9-13890df7a9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:38.573821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cce44-9852-400b-bbd9-13890df7a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:38.574096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cce44-9852-400b-bbd9-13890df7a9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:38.574828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cce44-9852-400b-bbd9-13890df7a9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:38.576627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cce44-9852-400b-bbd9-13890df7a9c0 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:38.587709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1019/2003] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:38.592271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323c269-8189-4585-a111-2165cd642d81 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:38.602420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323c269-8189-4585-a111-2165cd642d81 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:38.607931 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e1a8b-0087-4305-b3f8-a319548a6710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:38.608530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e1a8b-0087-4305-b3f8-a319548a6710 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:38.608819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e1a8b-0087-4305-b3f8-a319548a6710 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:38.609112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e1a8b-0087-4305-b3f8-a319548a6710 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:38.609841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e1a8b-0087-4305-b3f8-a319548a6710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:38.611484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e1a8b-0087-4305-b3f8-a319548a6710 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:38.613562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:38.622571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 985/2004] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:38.626976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cce44-9852-400b-bbd9-13890df7a9c0 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:38.636967 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cce44-9852-400b-bbd9-13890df7a9c0 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:38.641651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4da22-1b0a-4a40-b4a7-414ad0bf3b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:38.642530 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4da22-1b0a-4a40-b4a7-414ad0bf3b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:38.642873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4da22-1b0a-4a40-b4a7-414ad0bf3b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:38.643498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4da22-1b0a-4a40-b4a7-414ad0bf3b31 admin admin] PATH_INFO: `/v3/projects/ef2c4e951d344edf9b3adcae45805d4f/users/ce5061898b1d48c68aa1a8ea9e051129/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:38.661318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4da22-1b0a-4a40-b4a7-414ad0bf3b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2c4e951d344edf9b3adcae45805d4f, user_id=ce5061898b1d48c68aa1a8ea9e051129, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:38.664096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4da22-1b0a-4a40-b4a7-414ad0bf3b31 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:38.801417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1020/2005] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:38 2022] PUT /identity/v3/projects/ef2c4e951d344edf9b3adcae45805d4f/users/ce5061898b1d48c68aa1a8ea9e051129/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:38.811965 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbb275-c688-4c7a-a857-37c3afb9d5bc None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:38.812258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbb275-c688-4c7a-a857-37c3afb9d5bc None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:38.812544 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbb275-c688-4c7a-a857-37c3afb9d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:38.840396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-2fdbb275-c688-4c7a-a857-37c3afb9d5bc None None] MFA Rules not processed for user `ce5061898b1d48c68aa1a8ea9e051129`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:38.841686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2fdbb275-c688-4c7a-a857-37c3afb9d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:38.904807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 986/2006] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:38.909338 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4da22-1b0a-4a40-b4a7-414ad0bf3b31 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:38.971421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4da22-1b0a-4a40-b4a7-414ad0bf3b31 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:38.976645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2f563-0180-47f4-81e3-93e2fe0d8cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:38.977294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2f563-0180-47f4-81e3-93e2fe0d8cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:38.977574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2f563-0180-47f4-81e3-93e2fe0d8cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:38.977849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2f563-0180-47f4-81e3-93e2fe0d8cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:38.978543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2f563-0180-47f4-81e3-93e2fe0d8cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:38.980655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2f563-0180-47f4-81e3-93e2fe0d8cb9 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:39.066289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1021/2007] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:38 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:39.070050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbb275-c688-4c7a-a857-37c3afb9d5bc None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:39.081917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbb275-c688-4c7a-a857-37c3afb9d5bc None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:39.139315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b709c-6779-4a3b-b363-e95defcfef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:39.140015 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b709c-6779-4a3b-b363-e95defcfef66 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:39.140292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b709c-6779-4a3b-b363-e95defcfef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:39.140568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b709c-6779-4a3b-b363-e95defcfef66 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:39.141247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b709c-6779-4a3b-b363-e95defcfef66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:39.143207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b709c-6779-4a3b-b363-e95defcfef66 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:39.325749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 987/2008] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:39 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:39.327002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2f563-0180-47f4-81e3-93e2fe0d8cb9 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:39.338177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2f563-0180-47f4-81e3-93e2fe0d8cb9 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:39.343077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1ceac-27ae-4faa-aafb-88c88eef4a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:39.343746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1ceac-27ae-4faa-aafb-88c88eef4a99 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:39.344028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1ceac-27ae-4faa-aafb-88c88eef4a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:39.344307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1ceac-27ae-4faa-aafb-88c88eef4a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:39.345036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1ceac-27ae-4faa-aafb-88c88eef4a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:39.346655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1ceac-27ae-4faa-aafb-88c88eef4a99 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:39.357560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1022/2009] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:02:39.362002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b709c-6779-4a3b-b363-e95defcfef66 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:39.373075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b709c-6779-4a3b-b363-e95defcfef66 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:39.377581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a40a94-7294-48d3-905c-60634804fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:39.378473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a40a94-7294-48d3-905c-60634804fa62 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:39.378738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a40a94-7294-48d3-905c-60634804fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:39.379041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a40a94-7294-48d3-905c-60634804fa62 admin admin] PATH_INFO: `/v3/projects/3de4a7a5e8604121b4d00a128bb6ee61/users/4985fad5ead346af94688559f2770cbb/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:39.395369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a40a94-7294-48d3-905c-60634804fa62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de4a7a5e8604121b4d00a128bb6ee61, user_id=4985fad5ead346af94688559f2770cbb, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:39.401312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a40a94-7294-48d3-905c-60634804fa62 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:39.510072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 988/2010] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:39 2022] PUT /identity/v3/projects/3de4a7a5e8604121b4d00a128bb6ee61/users/4985fad5ead346af94688559f2770cbb/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:39.516045 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1ceac-27ae-4faa-aafb-88c88eef4a99 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:39.526194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1ceac-27ae-4faa-aafb-88c88eef4a99 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:39.547702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:39.584012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df93b03-b855-461b-9782-b7e2dfe3875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:39.584722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df93b03-b855-461b-9782-b7e2dfe3875a admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:39.585003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df93b03-b855-461b-9782-b7e2dfe3875a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:39.585277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df93b03-b855-461b-9782-b7e2dfe3875a admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:39.585999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df93b03-b855-461b-9782-b7e2dfe3875a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:39.587626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df93b03-b855-461b-9782-b7e2dfe3875a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:39.597291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1023/2011] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:39.601655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a40a94-7294-48d3-905c-60634804fa62 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:39.613012 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a40a94-7294-48d3-905c-60634804fa62 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:39.617593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac29352-2cdd-4fc5-86f5-9564e3aeab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:39.618469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac29352-2cdd-4fc5-86f5-9564e3aeab4a admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:39.618809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac29352-2cdd-4fc5-86f5-9564e3aeab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:39.619123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac29352-2cdd-4fc5-86f5-9564e3aeab4a admin admin] PATH_INFO: `/v3/projects/3de4a7a5e8604121b4d00a128bb6ee61/users/4985fad5ead346af94688559f2770cbb/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:39.621881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac29352-2cdd-4fc5-86f5-9564e3aeab4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de4a7a5e8604121b4d00a128bb6ee61, user_id=4985fad5ead346af94688559f2770cbb, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:39.624951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac29352-2cdd-4fc5-86f5-9564e3aeab4a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:39.638091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 989/2012] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:39 2022] PUT /identity/v3/projects/3de4a7a5e8604121b4d00a128bb6ee61/users/4985fad5ead346af94688559f2770cbb/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:39.649529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4fbb-f9a6-4334-88a6-71e8917044ce None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:39.650090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4fbb-f9a6-4334-88a6-71e8917044ce None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:39.650090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a4fbb-f9a6-4334-88a6-71e8917044ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:39.678881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7b4a4fbb-f9a6-4334-88a6-71e8917044ce None None] MFA Rules not processed for user `4985fad5ead346af94688559f2770cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:39.680136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7b4a4fbb-f9a6-4334-88a6-71e8917044ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:39.757017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1024/2013] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:39.767093 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac29352-2cdd-4fc5-86f5-9564e3aeab4a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:39.768876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-cac29352-2cdd-4fc5-86f5-9564e3aeab4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:39.816690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:39.830501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac29352-2cdd-4fc5-86f5-9564e3aeab4a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:39.834300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c9f35-4b05-4c83-97ec-7b805ea0e202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:39.834947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9f35-4b05-4c83-97ec-7b805ea0e202 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:39.835263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9f35-4b05-4c83-97ec-7b805ea0e202 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:39.835541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c9f35-4b05-4c83-97ec-7b805ea0e202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:39.895526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c9f35-4b05-4c83-97ec-7b805ea0e202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:39.897130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c9f35-4b05-4c83-97ec-7b805ea0e202 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:39.907338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 990/2014] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:46.831129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a4fbb-f9a6-4334-88a6-71e8917044ce None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:46.833591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7b4a4fbb-f9a6-4334-88a6-71e8917044ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:46.937829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a4fbb-f9a6-4334-88a6-71e8917044ce None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:46.944492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:46.945391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:46.947207 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:46.947525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] PATH_INFO: `/v3/users/13231eddd7554522954a871080db33a0` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:46.951696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13231eddd7554522954a871080db33a0)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:46.953811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:47.168218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13231eddd7554522954a871080db33a0'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:47.168983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13231eddd7554522954a871080db33a0'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:47.169674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13231eddd7554522954a871080db33a0'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:47.171581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:47.258100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13231eddd7554522954a871080db33a0'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:47.267559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13231eddd7554522954a871080db33a0'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:47.287193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1025/2015] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:46 2022] DELETE /identity/v3/users/13231eddd7554522954a871080db33a0 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:47.292085 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a346-cf03-4e20-810a-382fea22a9ff None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:47.292669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a346-cf03-4e20-810a-382fea22a9ff None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:47.292841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477a346-cf03-4e20-810a-382fea22a9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:47.311232 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3477a346-cf03-4e20-810a-382fea22a9ff None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:47.312443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3477a346-cf03-4e20-810a-382fea22a9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:47.376821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 991/2016] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:02:47.386713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:47.388609 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:47.448147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8d21c-9d23-4a82-866f-fa7e3b17fa57 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:47.451903 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bb38-8e44-45b9-a143-d0d94b826221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:47.452542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bb38-8e44-45b9-a143-d0d94b826221 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:47.452824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bb38-8e44-45b9-a143-d0d94b826221 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:47.453096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595bb38-8e44-45b9-a143-d0d94b826221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:47.462555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595bb38-8e44-45b9-a143-d0d94b826221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:47.464790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9595bb38-8e44-45b9-a143-d0d94b826221 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:47.478133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1026/2017] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:47.973566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477a346-cf03-4e20-810a-382fea22a9ff None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:47.975059 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3477a346-cf03-4e20-810a-382fea22a9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:47.988336 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477a346-cf03-4e20-810a-382fea22a9ff None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:47.993383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:47.995967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:47.995967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:47.995967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] PATH_INFO: `/v3/projects/575140880cd64e8aa4331792e742eed4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:47.996225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] RBAC: Authorizing `identity:delete_project(project_id=575140880cd64e8aa4331792e742eed4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:47.998069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:48.140246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575140880cd64e8aa4331792e742eed4', 'request_id': 'req-145eebf5-322d-479a-b24c-e9351c73608b'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:48.145935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575140880cd64e8aa4331792e742eed4', 'request_id': 'req-145eebf5-322d-479a-b24c-e9351c73608b'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:48.152429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575140880cd64e8aa4331792e742eed4', 'request_id': 'req-145eebf5-322d-479a-b24c-e9351c73608b'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:48.314739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] The token cache is being invalidate because project 575140880cd64e8aa4331792e742eed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:48.315483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:48.315665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:48.317251 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 992/2018] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:47 2022] DELETE /identity/v3/projects/575140880cd64e8aa4331792e742eed4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:48.321226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bb38-8e44-45b9-a143-d0d94b826221 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:48.332129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595bb38-8e44-45b9-a143-d0d94b826221 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:48.388461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:48.389325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:48.389611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:48.389898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] PATH_INFO: `/v3/users/10b80d2c9a21459f85e82793eff84f22` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:48.391159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b80d2c9a21459f85e82793eff84f22)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:48.393122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:48.567026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b80d2c9a21459f85e82793eff84f22'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:48.567688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b80d2c9a21459f85e82793eff84f22'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:48.568296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b80d2c9a21459f85e82793eff84f22'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:48.629527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b80d2c9a21459f85e82793eff84f22'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:48.637270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b80d2c9a21459f85e82793eff84f22'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:48.642625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:48.654783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1027/2019] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:48 2022] DELETE /identity/v3/users/10b80d2c9a21459f85e82793eff84f22 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:49.222259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:49.223863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:49.246077 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145eebf5-322d-479a-b24c-e9351c73608b admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:49.262660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:49.307633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:49.308582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:49.308861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:49.309139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] PATH_INFO: `/v3/projects/1ac09c936b814e95bd67e15c469ed261` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:49.310349 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac09c936b814e95bd67e15c469ed261)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:49.312296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:49.425142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac09c936b814e95bd67e15c469ed261', 'request_id': 'req-db50e5ea-923d-489d-8eae-f16e98b1835a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:49.430576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac09c936b814e95bd67e15c469ed261', 'request_id': 'req-db50e5ea-923d-489d-8eae-f16e98b1835a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:49.438571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac09c936b814e95bd67e15c469ed261', 'request_id': 'req-db50e5ea-923d-489d-8eae-f16e98b1835a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:49.547542 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] The token cache is being invalidate because project 1ac09c936b814e95bd67e15c469ed261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:49.547888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:49.548543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:49.550145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 993/2020] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:49 2022] DELETE /identity/v3/projects/1ac09c936b814e95bd67e15c469ed261 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:49.554240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:49.555696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:49.569507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6a715-d00b-4e0a-9a24-b0a01142867b admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:49.626687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:49.627591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:49.627871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:49.628145 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] PATH_INFO: `/v3/users/af20c88ee3c145d8939fc8b8a0704071` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:49.629309 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=af20c88ee3c145d8939fc8b8a0704071)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:49.631271 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:49.832078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af20c88ee3c145d8939fc8b8a0704071'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:49.832721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af20c88ee3c145d8939fc8b8a0704071'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:49.833321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af20c88ee3c145d8939fc8b8a0704071'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:49.892399 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af20c88ee3c145d8939fc8b8a0704071'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:49.899987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3440fb41-3abb-4aae-b7c3-5db1e90107ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af20c88ee3c145d8939fc8b8a0704071'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:49.918147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1028/2021] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:49 2022] DELETE /identity/v3/users/af20c88ee3c145d8939fc8b8a0704071 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:50.415366 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:50.417747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:50.435742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50e5ea-923d-489d-8eae-f16e98b1835a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:50.511146 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:50.512293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:50.512704 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:50.513088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] PATH_INFO: `/v3/projects/c0fc8a33e49a406e95a6ee8c42eddceb` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:50.514386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0fc8a33e49a406e95a6ee8c42eddceb)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:50.516427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:50.708724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0fc8a33e49a406e95a6ee8c42eddceb', 'request_id': 'req-c596c9f8-d518-40c9-b53c-121fba0e8d3c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:50.710153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:50.715902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0fc8a33e49a406e95a6ee8c42eddceb', 'request_id': 'req-c596c9f8-d518-40c9-b53c-121fba0e8d3c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:50.722961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0fc8a33e49a406e95a6ee8c42eddceb', 'request_id': 'req-c596c9f8-d518-40c9-b53c-121fba0e8d3c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:50.855963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] The token cache is being invalidate because project c0fc8a33e49a406e95a6ee8c42eddceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:50.856419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:50.857659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c596c9f8-d518-40c9-b53c-121fba0e8d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:50.858783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 994/2022] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:50 2022] DELETE /identity/v3/projects/c0fc8a33e49a406e95a6ee8c42eddceb => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:50.864607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae421e-61f7-4c2a-8aad-0138637a535e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:50.865206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae421e-61f7-4c2a-8aad-0138637a535e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:50.865206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae421e-61f7-4c2a-8aad-0138637a535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:50.894780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-62ae421e-61f7-4c2a-8aad-0138637a535e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:50.896050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-62ae421e-61f7-4c2a-8aad-0138637a535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:50.945059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:50.955100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1029/2023] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:50.964460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f894d5-6203-4306-99e8-17346e0dadbb None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:50.964790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f894d5-6203-4306-99e8-17346e0dadbb None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:50.965077 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f894d5-6203-4306-99e8-17346e0dadbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:50.986178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-c5f894d5-6203-4306-99e8-17346e0dadbb None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:50.987453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c5f894d5-6203-4306-99e8-17346e0dadbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:50.995916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 995/2024] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:51.001511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae421e-61f7-4c2a-8aad-0138637a535e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:51.012098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae421e-61f7-4c2a-8aad-0138637a535e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:51.017158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a204b4-6d46-40f7-aff4-cad0c91a8611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:51.017805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a204b4-6d46-40f7-aff4-cad0c91a8611 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:51.018118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a204b4-6d46-40f7-aff4-cad0c91a8611 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:51.018454 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a204b4-6d46-40f7-aff4-cad0c91a8611 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:51.019208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a204b4-6d46-40f7-aff4-cad0c91a8611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:02:51.019526 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a204b4-6d46-40f7-aff4-cad0c91a8611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:51.021117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a204b4-6d46-40f7-aff4-cad0c91a8611 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:51.037294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1030/2025] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:02:51.039277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f894d5-6203-4306-99e8-17346e0dadbb None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:51.048569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f894d5-6203-4306-99e8-17346e0dadbb None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:51.054240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b0a99-b2df-47f0-b9f8-14e5a4f8be9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:51.054891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0a99-b2df-47f0-b9f8-14e5a4f8be9a admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:51.055619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0a99-b2df-47f0-b9f8-14e5a4f8be9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:51.055908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b0a99-b2df-47f0-b9f8-14e5a4f8be9a admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:51.056626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b0a99-b2df-47f0-b9f8-14e5a4f8be9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:51.059080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b0a99-b2df-47f0-b9f8-14e5a4f8be9a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:51.187042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 996/2026] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:51 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:51.188215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a204b4-6d46-40f7-aff4-cad0c91a8611 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:51.199066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a204b4-6d46-40f7-aff4-cad0c91a8611 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:51.269656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18514e0-bb63-4c4e-9c13-f193fbe916d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:51.270390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18514e0-bb63-4c4e-9c13-f193fbe916d2 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:51.270682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18514e0-bb63-4c4e-9c13-f193fbe916d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:51.270962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18514e0-bb63-4c4e-9c13-f193fbe916d2 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:51.271800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18514e0-bb63-4c4e-9c13-f193fbe916d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:51.274145 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18514e0-bb63-4c4e-9c13-f193fbe916d2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:51.417205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1031/2027] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:51 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:02:51.421393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b0a99-b2df-47f0-b9f8-14e5a4f8be9a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:51.431724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b0a99-b2df-47f0-b9f8-14e5a4f8be9a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:51.437134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13900214-f0b5-425b-a7a9-89e6b36bfc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:51.437797 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13900214-f0b5-425b-a7a9-89e6b36bfc50 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:51.438077 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13900214-f0b5-425b-a7a9-89e6b36bfc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:51.438353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13900214-f0b5-425b-a7a9-89e6b36bfc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:51.439118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13900214-f0b5-425b-a7a9-89e6b36bfc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:51.440815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13900214-f0b5-425b-a7a9-89e6b36bfc50 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:51.453023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 997/2028] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:51.457503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18514e0-bb63-4c4e-9c13-f193fbe916d2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:51.467740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18514e0-bb63-4c4e-9c13-f193fbe916d2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:51.472517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ccd0f-a38b-42c6-9fe3-6394669796e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:51.473219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ccd0f-a38b-42c6-9fe3-6394669796e9 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:51.473501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ccd0f-a38b-42c6-9fe3-6394669796e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:51.473779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ccd0f-a38b-42c6-9fe3-6394669796e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:51.474579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ccd0f-a38b-42c6-9fe3-6394669796e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:51.476135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ccd0f-a38b-42c6-9fe3-6394669796e9 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:51.490559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1032/2029] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:51.492089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13900214-f0b5-425b-a7a9-89e6b36bfc50 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:51.503656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13900214-f0b5-425b-a7a9-89e6b36bfc50 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:51.508405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b6726-e3db-4f06-85a9-829594f2165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:51.509364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6726-e3db-4f06-85a9-829594f2165a admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:51.509715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6726-e3db-4f06-85a9-829594f2165a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:51.510079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b6726-e3db-4f06-85a9-829594f2165a admin admin] PATH_INFO: `/v3/projects/a83dbf3421ae4229af540fbbc387b7c6/users/f4dfce3aad184c278455d6c2e726f98f/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:51.528765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b6726-e3db-4f06-85a9-829594f2165a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83dbf3421ae4229af540fbbc387b7c6, user_id=f4dfce3aad184c278455d6c2e726f98f, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:51.531534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b6726-e3db-4f06-85a9-829594f2165a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:51.597592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ccd0f-a38b-42c6-9fe3-6394669796e9 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:51.599407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-321ccd0f-a38b-42c6-9fe3-6394669796e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:51.628322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 998/2030] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:51 2022] PUT /identity/v3/projects/a83dbf3421ae4229af540fbbc387b7c6/users/f4dfce3aad184c278455d6c2e726f98f/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:51.637627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ccb9-aa72-4503-bc9c-9e5ff4cc1df3 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:51.637915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ccb9-aa72-4503-bc9c-9e5ff4cc1df3 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:51.638195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ccb9-aa72-4503-bc9c-9e5ff4cc1df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:51.679268 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-c292ccb9-aa72-4503-bc9c-9e5ff4cc1df3 None None] MFA Rules not processed for user `f4dfce3aad184c278455d6c2e726f98f`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:51.680527 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c292ccb9-aa72-4503-bc9c-9e5ff4cc1df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:51.692707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ccd0f-a38b-42c6-9fe3-6394669796e9 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:51.742117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6755b-219d-4a45-8e73-a40d13b6558a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:51.742765 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6755b-219d-4a45-8e73-a40d13b6558a service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:51.743115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6755b-219d-4a45-8e73-a40d13b6558a service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:51.748516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6755b-219d-4a45-8e73-a40d13b6558a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:51.748516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-42a6755b-219d-4a45-8e73-a40d13b6558a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:51.754461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 999/2031] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:51.758785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ccb9-aa72-4503-bc9c-9e5ff4cc1df3 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:51.780892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:51.811177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6755b-219d-4a45-8e73-a40d13b6558a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:51.812620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6755b-219d-4a45-8e73-a40d13b6558a service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:51.822306 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1033/2032] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:51.824062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ccb9-aa72-4503-bc9c-9e5ff4cc1df3 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:51.829540 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd30b-e7e3-44fe-b924-f8262645a04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:51.830208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd30b-e7e3-44fe-b924-f8262645a04b admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:51.830496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd30b-e7e3-44fe-b924-f8262645a04b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:51.830775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd30b-e7e3-44fe-b924-f8262645a04b admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:51.831510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bd30b-e7e3-44fe-b924-f8262645a04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:51.833443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bd30b-e7e3-44fe-b924-f8262645a04b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:51.842389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:51.986230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1000/2033] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:51 2022] POST /identity/v3/projects => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:02:51.990481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6755b-219d-4a45-8e73-a40d13b6558a service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:52.001328 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6755b-219d-4a45-8e73-a40d13b6558a service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:52.061369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125878ce-b545-48d4-b7e2-ec6da122a011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:52.062046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125878ce-b545-48d4-b7e2-ec6da122a011 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:52.062329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125878ce-b545-48d4-b7e2-ec6da122a011 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:52.062604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125878ce-b545-48d4-b7e2-ec6da122a011 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:52.063365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125878ce-b545-48d4-b7e2-ec6da122a011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:52.065316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125878ce-b545-48d4-b7e2-ec6da122a011 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:52.158288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1034/2034] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:51 2022] POST /identity/v3/users => generated 290 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:52.162247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd30b-e7e3-44fe-b924-f8262645a04b admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:52.174239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd30b-e7e3-44fe-b924-f8262645a04b admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:52.179518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4898-b99f-4b0d-ba4e-b92f1c38895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:52.180306 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4898-b99f-4b0d-ba4e-b92f1c38895b admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:52.180607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4898-b99f-4b0d-ba4e-b92f1c38895b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:52.185639 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4898-b99f-4b0d-ba4e-b92f1c38895b admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:52.185639 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f4898-b99f-4b0d-ba4e-b92f1c38895b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:52.185639 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f4898-b99f-4b0d-ba4e-b92f1c38895b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:52.194003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1001/2035] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:52.198935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125878ce-b545-48d4-b7e2-ec6da122a011 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:52.209351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125878ce-b545-48d4-b7e2-ec6da122a011 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:52.214859 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454961a8-8bd1-4e52-aab5-32f07484c37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:52.215981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454961a8-8bd1-4e52-aab5-32f07484c37d admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:52.216450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454961a8-8bd1-4e52-aab5-32f07484c37d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:52.217410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454961a8-8bd1-4e52-aab5-32f07484c37d admin admin] PATH_INFO: `/v3/projects/b99fb41b3c7b42638c759768d3297d96/users/31eab90627e647dd9c7bf1892ea9a0ac/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:52.233495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454961a8-8bd1-4e52-aab5-32f07484c37d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99fb41b3c7b42638c759768d3297d96, user_id=31eab90627e647dd9c7bf1892ea9a0ac, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:52.236247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454961a8-8bd1-4e52-aab5-32f07484c37d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:52.395848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1035/2036] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:52 2022] PUT /identity/v3/projects/b99fb41b3c7b42638c759768d3297d96/users/31eab90627e647dd9c7bf1892ea9a0ac/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:52.397120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4898-b99f-4b0d-ba4e-b92f1c38895b admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:52.408011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4898-b99f-4b0d-ba4e-b92f1c38895b admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:52.471024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eabcc4-7147-4dbe-ae65-2fe000e2c818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:52.471762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eabcc4-7147-4dbe-ae65-2fe000e2c818 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:52.471947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eabcc4-7147-4dbe-ae65-2fe000e2c818 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:52.472220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eabcc4-7147-4dbe-ae65-2fe000e2c818 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:52.472947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eabcc4-7147-4dbe-ae65-2fe000e2c818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:52.474582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eabcc4-7147-4dbe-ae65-2fe000e2c818 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:52.484844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1002/2037] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:52.489119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454961a8-8bd1-4e52-aab5-32f07484c37d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:52.500595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454961a8-8bd1-4e52-aab5-32f07484c37d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:52.505329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52e333-c917-4bba-a7e2-ff7454a6c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:52.506241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52e333-c917-4bba-a7e2-ff7454a6c6fb admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:52.506522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52e333-c917-4bba-a7e2-ff7454a6c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:52.506804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52e333-c917-4bba-a7e2-ff7454a6c6fb admin admin] PATH_INFO: `/v3/projects/b99fb41b3c7b42638c759768d3297d96/users/31eab90627e647dd9c7bf1892ea9a0ac/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:52.508838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52e333-c917-4bba-a7e2-ff7454a6c6fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99fb41b3c7b42638c759768d3297d96, user_id=31eab90627e647dd9c7bf1892ea9a0ac, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:52.512097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52e333-c917-4bba-a7e2-ff7454a6c6fb admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:52.526665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1036/2038] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:52 2022] PUT /identity/v3/projects/b99fb41b3c7b42638c759768d3297d96/users/31eab90627e647dd9c7bf1892ea9a0ac/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:52.533773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadaf25-cf79-414a-827f-b643cac349a5 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:52.534065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadaf25-cf79-414a-827f-b643cac349a5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:52.534384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadaf25-cf79-414a-827f-b643cac349a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:52.561479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-aeadaf25-cf79-414a-827f-b643cac349a5 None None] MFA Rules not processed for user `31eab90627e647dd9c7bf1892ea9a0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:52.562684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-aeadaf25-cf79-414a-827f-b643cac349a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:52.656482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1003/2039] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:52.671545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52e333-c917-4bba-a7e2-ff7454a6c6fb admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:52.671545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bf52e333-c917-4bba-a7e2-ff7454a6c6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:52.730401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52e333-c917-4bba-a7e2-ff7454a6c6fb admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:52.735055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edfba3-11e3-4d31-a6d8-e0761c8781e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:52.739311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edfba3-11e3-4d31-a6d8-e0761c8781e6 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:52.739311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edfba3-11e3-4d31-a6d8-e0761c8781e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:52.739311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edfba3-11e3-4d31-a6d8-e0761c8781e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:52.748613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edfba3-11e3-4d31-a6d8-e0761c8781e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:52.750140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edfba3-11e3-4d31-a6d8-e0761c8781e6 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:52.764448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1037/2040] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:52.977265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadaf25-cf79-414a-827f-b643cac349a5 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:52.988153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadaf25-cf79-414a-827f-b643cac349a5 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:52.991736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf2009-6b2f-49ce-b173-48b13e96d7e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:52.992367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf2009-6b2f-49ce-b173-48b13e96d7e8 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:52.992648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf2009-6b2f-49ce-b173-48b13e96d7e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:52.992917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf2009-6b2f-49ce-b173-48b13e96d7e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:53.049606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf2009-6b2f-49ce-b173-48b13e96d7e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:53.051084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf2009-6b2f-49ce-b173-48b13e96d7e8 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:53.054681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:53.060919 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1004/2041] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:02:56.833373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404946bb-839e-448d-9f55-7f799a8939ac None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:56.837733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404946bb-839e-448d-9f55-7f799a8939ac None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:56.837733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404946bb-839e-448d-9f55-7f799a8939ac None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:56.837733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1038/2042] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:02:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:02:56.851921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408618e4-2311-47d0-9c21-054ceaf1fb67 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:56.852460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408618e4-2311-47d0-9c21-054ceaf1fb67 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:56.852460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408618e4-2311-47d0-9c21-054ceaf1fb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:56.912134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-408618e4-2311-47d0-9c21-054ceaf1fb67 None None] MFA Rules not processed for user `b6375aed65de46e19a9d3da583b42bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:56.913272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-408618e4-2311-47d0-9c21-054ceaf1fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:56.993725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404946bb-839e-448d-9f55-7f799a8939ac None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:56.995840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1005/2043] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:02:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:56.996263 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-404946bb-839e-448d-9f55-7f799a8939ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:57.010749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408618e4-2311-47d0-9c21-054ceaf1fb67 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:57.012960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-408618e4-2311-47d0-9c21-054ceaf1fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:57.025809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408618e4-2311-47d0-9c21-054ceaf1fb67 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:57.031680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a98cc-669d-47ab-9b27-059d141926ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:57.031821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:57.032337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a98cc-669d-47ab-9b27-059d141926ca service placement] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:57.032627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a98cc-669d-47ab-9b27-059d141926ca service placement] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:57.032916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a98cc-669d-47ab-9b27-059d141926ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:57.041749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a98cc-669d-47ab-9b27-059d141926ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:57.043562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a98cc-669d-47ab-9b27-059d141926ca service placement] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:57.054300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1006/2044] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:02:57.074776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404946bb-839e-448d-9f55-7f799a8939ac None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:57.080809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:57.082078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:57.082427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:57.082890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] PATH_INFO: `/v3/users/a0a7beec276446abbfcaebf6d0dad46a` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:57.084343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a7beec276446abbfcaebf6d0dad46a)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:57.086485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:57.469229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a7beec276446abbfcaebf6d0dad46a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:57.469897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a7beec276446abbfcaebf6d0dad46a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:57.470496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a7beec276446abbfcaebf6d0dad46a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:57.624104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a7beec276446abbfcaebf6d0dad46a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:57.631513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7bd81ad5-c096-4d46-8ba9-f188dfdbba9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a7beec276446abbfcaebf6d0dad46a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:57.649963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1039/2045] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:02:56 2022] DELETE /identity/v3/users/a0a7beec276446abbfcaebf6d0dad46a => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:57.949069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a98cc-669d-47ab-9b27-059d141926ca service placement] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:57.960115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a98cc-669d-47ab-9b27-059d141926ca service placement] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:58.031816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:58.033355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:58.033355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:58.033355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] PATH_INFO: `/v3/projects/fd46f9321b0a4f3b8e5b46ea83a49d2a` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:58.034439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd46f9321b0a4f3b8e5b46ea83a49d2a)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:58.036413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:58.155677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:58.163811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd46f9321b0a4f3b8e5b46ea83a49d2a', 'request_id': 'req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:58.171433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd46f9321b0a4f3b8e5b46ea83a49d2a', 'request_id': 'req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:58.178764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd46f9321b0a4f3b8e5b46ea83a49d2a', 'request_id': 'req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:58.245816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] The token cache is being invalidate because project fd46f9321b0a4f3b8e5b46ea83a49d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:02:58.246108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:58.246878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5c4c076d-6733-4976-8e5b-bcd0dcc9a774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:02:58.248643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1007/2046] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:02:57 2022] DELETE /identity/v3/projects/fd46f9321b0a4f3b8e5b46ea83a49d2a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:02:58.253898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efacc5e-f115-4cb8-b75a-9c4e1d16361a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:58.254365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efacc5e-f115-4cb8-b75a-9c4e1d16361a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:58.254476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efacc5e-f115-4cb8-b75a-9c4e1d16361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:58.273419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-1efacc5e-f115-4cb8-b75a-9c4e1d16361a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:58.274620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1efacc5e-f115-4cb8-b75a-9c4e1d16361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:58.343581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1040/2047] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:58.354741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c27283-2591-4008-a0dd-8b47e8f1cffc None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:58.355186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c27283-2591-4008-a0dd-8b47e8f1cffc None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:58.355481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c27283-2591-4008-a0dd-8b47e8f1cffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:58.375833 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-69c27283-2591-4008-a0dd-8b47e8f1cffc None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:58.377107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-69c27283-2591-4008-a0dd-8b47e8f1cffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:58.386097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1008/2048] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:58.390518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efacc5e-f115-4cb8-b75a-9c4e1d16361a None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:58.400305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efacc5e-f115-4cb8-b75a-9c4e1d16361a None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:58.405541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ee1fc-6e20-4b1c-b632-45471e9b6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:58.406190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee1fc-6e20-4b1c-b632-45471e9b6370 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:58.406474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee1fc-6e20-4b1c-b632-45471e9b6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:58.406748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ee1fc-6e20-4b1c-b632-45471e9b6370 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:58.407508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ee1fc-6e20-4b1c-b632-45471e9b6370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:02:58.407813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ee1fc-6e20-4b1c-b632-45471e9b6370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:58.409398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ee1fc-6e20-4b1c-b632-45471e9b6370 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:58.427002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1041/2049] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:02:58.429135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c27283-2591-4008-a0dd-8b47e8f1cffc None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:58.438780 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c27283-2591-4008-a0dd-8b47e8f1cffc None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:58.443524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f54e8-26f6-4e8b-9a62-1091f4cd162c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:58.444119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f54e8-26f6-4e8b-9a62-1091f4cd162c admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:58.444401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f54e8-26f6-4e8b-9a62-1091f4cd162c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:58.444680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f54e8-26f6-4e8b-9a62-1091f4cd162c admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:58.445405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f54e8-26f6-4e8b-9a62-1091f4cd162c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:58.447343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f54e8-26f6-4e8b-9a62-1091f4cd162c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:58.522451 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1009/2050] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:02:58 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:58.527307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ee1fc-6e20-4b1c-b632-45471e9b6370 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:58.537283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ee1fc-6e20-4b1c-b632-45471e9b6370 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:58.566137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:02:58.596040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64481576-6e78-4860-9682-8095373673c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:58.596711 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64481576-6e78-4860-9682-8095373673c6 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:58.596998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64481576-6e78-4860-9682-8095373673c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:58.597285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64481576-6e78-4860-9682-8095373673c6 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:58.597992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64481576-6e78-4860-9682-8095373673c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:58.599960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64481576-6e78-4860-9682-8095373673c6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:58.693823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1042/2051] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:02:58 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:02:58.695050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f54e8-26f6-4e8b-9a62-1091f4cd162c admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:58.707473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f54e8-26f6-4e8b-9a62-1091f4cd162c admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:58.713758 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078aa9b-0f90-466f-b72c-5f906abce79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:58.714902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078aa9b-0f90-466f-b72c-5f906abce79c admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:58.715227 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078aa9b-0f90-466f-b72c-5f906abce79c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:58.715511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078aa9b-0f90-466f-b72c-5f906abce79c admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:58.716279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078aa9b-0f90-466f-b72c-5f906abce79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:58.718053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078aa9b-0f90-466f-b72c-5f906abce79c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:58.729350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1010/2052] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:58.733320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64481576-6e78-4860-9682-8095373673c6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:58.745044 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64481576-6e78-4860-9682-8095373673c6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:58.749960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa5dfb-a76e-485e-bf64-9188c2674ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:58.750610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa5dfb-a76e-485e-bf64-9188c2674ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:58.750892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa5dfb-a76e-485e-bf64-9188c2674ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:58.751209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa5dfb-a76e-485e-bf64-9188c2674ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:58.751970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa5dfb-a76e-485e-bf64-9188c2674ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:58.753548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa5dfb-a76e-485e-bf64-9188c2674ac4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:58.764447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1043/2053] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:02:58.768672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078aa9b-0f90-466f-b72c-5f906abce79c admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:58.780216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078aa9b-0f90-466f-b72c-5f906abce79c admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:58.784580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e5aa-bcbf-4a0f-8833-fe573d09424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:58.785463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e5aa-bcbf-4a0f-8833-fe573d09424c admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:58.787065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e5aa-bcbf-4a0f-8833-fe573d09424c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:58.787065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2e5aa-bcbf-4a0f-8833-fe573d09424c admin admin] PATH_INFO: `/v3/projects/c76c3b88e1af4015842d58e3bec92075/users/94954697f2ba4d94bf0b7d55c4c1beb1/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:58.801353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2e5aa-bcbf-4a0f-8833-fe573d09424c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76c3b88e1af4015842d58e3bec92075, user_id=94954697f2ba4d94bf0b7d55c4c1beb1, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:58.804525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2e5aa-bcbf-4a0f-8833-fe573d09424c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:58.954719 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1011/2054] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:02:58 2022] PUT /identity/v3/projects/c76c3b88e1af4015842d58e3bec92075/users/94954697f2ba4d94bf0b7d55c4c1beb1/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:02:58.959844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c3681-2e1b-4ded-bfe2-3b2853364c3f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:58.960217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c3681-2e1b-4ded-bfe2-3b2853364c3f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:58.960500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c3681-2e1b-4ded-bfe2-3b2853364c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:58.980536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ec0c3681-2e1b-4ded-bfe2-3b2853364c3f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:02:58.981768 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ec0c3681-2e1b-4ded-bfe2-3b2853364c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:59.043849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1044/2055] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:02:59.053242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e5aa-bcbf-4a0f-8833-fe573d09424c admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:02:59.057960 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-eaa2e5aa-bcbf-4a0f-8833-fe573d09424c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:02:59.113493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2e5aa-bcbf-4a0f-8833-fe573d09424c admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:02:59.117173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5d4c5-9a75-4a31-aafa-7676d3383c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:02:59.117822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5d4c5-9a75-4a31-aafa-7676d3383c27 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:02:59.118103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5d4c5-9a75-4a31-aafa-7676d3383c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:02:59.118381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5d4c5-9a75-4a31-aafa-7676d3383c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:02:59.128954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5d4c5-9a75-4a31-aafa-7676d3383c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:02:59.130385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5d4c5-9a75-4a31-aafa-7676d3383c27 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:02:59.140620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1012/2056] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:03.660669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c3681-2e1b-4ded-bfe2-3b2853364c3f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:03.662411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ec0c3681-2e1b-4ded-bfe2-3b2853364c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:03.683578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c3681-2e1b-4ded-bfe2-3b2853364c3f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:03.688726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:03.689612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:03.689899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:03.690179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] PATH_INFO: `/v3/users/ce5061898b1d48c68aa1a8ea9e051129` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:03.691931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5061898b1d48c68aa1a8ea9e051129)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:03.694059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:04.176462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5d4c5-9a75-4a31-aafa-7676d3383c27 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:04.178104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-82a5d4c5-9a75-4a31-aafa-7676d3383c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:04.196532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5d4c5-9a75-4a31-aafa-7676d3383c27 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:04.204122 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:04.206304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:04.206741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:04.207773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] PATH_INFO: `/v3/users/f4dfce3aad184c278455d6c2e726f98f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:04.209728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4dfce3aad184c278455d6c2e726f98f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:04.212255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:04.239810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5061898b1d48c68aa1a8ea9e051129'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:04.241843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5061898b1d48c68aa1a8ea9e051129'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:04.242445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5061898b1d48c68aa1a8ea9e051129'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:04.382169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5061898b1d48c68aa1a8ea9e051129'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:04.392567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-56f742c9-2525-41de-96c3-f0ccad52e768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5061898b1d48c68aa1a8ea9e051129'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:04.420569 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1045/2057] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:03 2022] DELETE /identity/v3/users/ce5061898b1d48c68aa1a8ea9e051129 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:04.421940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f3fb-2e07-48b6-8c5f-8715ad328a7e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:04.422228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f3fb-2e07-48b6-8c5f-8715ad328a7e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:04.422505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f3fb-2e07-48b6-8c5f-8715ad328a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:04.443429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-de99f3fb-2e07-48b6-8c5f-8715ad328a7e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:04.445170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-de99f3fb-2e07-48b6-8c5f-8715ad328a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:04.466879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:04.542334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1046/2058] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:03:04.552238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99f3fb-2e07-48b6-8c5f-8715ad328a7e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:04.553702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-de99f3fb-2e07-48b6-8c5f-8715ad328a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:04.631212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99f3fb-2e07-48b6-8c5f-8715ad328a7e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:04.635494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a69b82-0abe-4efc-8a42-a38e0226b017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:04.636179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a69b82-0abe-4efc-8a42-a38e0226b017 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:04.636479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a69b82-0abe-4efc-8a42-a38e0226b017 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:04.636778 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a69b82-0abe-4efc-8a42-a38e0226b017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:04.646849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a69b82-0abe-4efc-8a42-a38e0226b017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:04.648850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a69b82-0abe-4efc-8a42-a38e0226b017 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:04.660405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1047/2059] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:03:04.735130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4dfce3aad184c278455d6c2e726f98f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:04.735130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4dfce3aad184c278455d6c2e726f98f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:04.735988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4dfce3aad184c278455d6c2e726f98f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:04.744617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4dfce3aad184c278455d6c2e726f98f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:04.751997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:04.764718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4dfce3aad184c278455d6c2e726f98f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:04.934780 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1013/2060] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:04 2022] DELETE /identity/v3/users/f4dfce3aad184c278455d6c2e726f98f => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:03:04.939527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a8d0d-c4da-472b-94d8-dff2f9be8697 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:04.939527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a8d0d-c4da-472b-94d8-dff2f9be8697 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:04.940094 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a8d0d-c4da-472b-94d8-dff2f9be8697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:04.971971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-144a8d0d-c4da-472b-94d8-dff2f9be8697 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:04.973226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-144a8d0d-c4da-472b-94d8-dff2f9be8697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:05.090884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1048/2061] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:05.102914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:05.109866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:05.196794 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee23569-f001-4420-9b6e-031d03081326 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:05.202525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f0a8-fc69-4e3f-a090-54bcbe3ebeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:05.203214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f0a8-fc69-4e3f-a090-54bcbe3ebeae service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:05.203497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f0a8-fc69-4e3f-a090-54bcbe3ebeae service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:05.203823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46f0a8-fc69-4e3f-a090-54bcbe3ebeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:05.217870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f0a8-fc69-4e3f-a090-54bcbe3ebeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:05.217995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46f0a8-fc69-4e3f-a090-54bcbe3ebeae service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:05.229690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1014/2062] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:05.235906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa2286-b0c3-4ec5-9908-d807cc7e9c68 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:05.236075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa2286-b0c3-4ec5-9908-d807cc7e9c68 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:05.236310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa2286-b0c3-4ec5-9908-d807cc7e9c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:05.272717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-6cfa2286-b0c3-4ec5-9908-d807cc7e9c68 None None] MFA Rules not processed for user `94954697f2ba4d94bf0b7d55c4c1beb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:05.273982 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6cfa2286-b0c3-4ec5-9908-d807cc7e9c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:05.319746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f0a8-fc69-4e3f-a090-54bcbe3ebeae service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:05.320996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ff46f0a8-fc69-4e3f-a090-54bcbe3ebeae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:05.336493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46f0a8-fc69-4e3f-a090-54bcbe3ebeae service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:05.342663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:05.346106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:05.346599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:05.346853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] PATH_INFO: `/v3/projects/ef2c4e951d344edf9b3adcae45805d4f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:05.349771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2c4e951d344edf9b3adcae45805d4f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:05.351801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:05.363107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1049/2063] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:05.368247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d509a-695c-4f7f-9db3-07d40e68840a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:05.368543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d509a-695c-4f7f-9db3-07d40e68840a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:05.368823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d509a-695c-4f7f-9db3-07d40e68840a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:05.393994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-fd9d509a-695c-4f7f-9db3-07d40e68840a None None] MFA Rules not processed for user `94954697f2ba4d94bf0b7d55c4c1beb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:05.395217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-fd9d509a-695c-4f7f-9db3-07d40e68840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:05.404427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1050/2064] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:03:05.415525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d509a-695c-4f7f-9db3-07d40e68840a None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:05.416976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-fd9d509a-695c-4f7f-9db3-07d40e68840a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:05.482282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2c4e951d344edf9b3adcae45805d4f', 'request_id': 'req-4d3529a5-5906-4de4-bc11-8e27037f3ada'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.488724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2c4e951d344edf9b3adcae45805d4f', 'request_id': 'req-4d3529a5-5906-4de4-bc11-8e27037f3ada'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.496190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2c4e951d344edf9b3adcae45805d4f', 'request_id': 'req-4d3529a5-5906-4de4-bc11-8e27037f3ada'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.524785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d509a-695c-4f7f-9db3-07d40e68840a None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:05.595400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] The token cache is being invalidate because project ef2c4e951d344edf9b3adcae45805d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:05.595400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.600458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd2d6b-914c-4333-a40d-b3d896867535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:05.601610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd2d6b-914c-4333-a40d-b3d896867535 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:05.601888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd2d6b-914c-4333-a40d-b3d896867535 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:05.602330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd2d6b-914c-4333-a40d-b3d896867535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:05.603470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.606478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1015/2065] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:05 2022] DELETE /identity/v3/projects/ef2c4e951d344edf9b3adcae45805d4f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:03:05.610752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:05.612714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:05.700646 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd2d6b-914c-4333-a40d-b3d896867535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:05.702727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd2d6b-914c-4333-a40d-b3d896867535 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:05.716187 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1051/2066] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:03:05.719097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3529a5-5906-4de4-bc11-8e27037f3ada admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:05.725236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:05.725883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:05.726164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:05.726452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] PATH_INFO: `/v3/users/4985fad5ead346af94688559f2770cbb` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:05.727739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4985fad5ead346af94688559f2770cbb)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:05.732563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:05.767000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd2d6b-914c-4333-a40d-b3d896867535 service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:05.767000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ecdd2d6b-914c-4333-a40d-b3d896867535 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:05.780594 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd2d6b-914c-4333-a40d-b3d896867535 service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:05.786956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:05.787919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:05.788202 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:05.788478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] PATH_INFO: `/v3/projects/a83dbf3421ae4229af540fbbc387b7c6` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:05.789780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83dbf3421ae4229af540fbbc387b7c6)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:05.791925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:05.945086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4985fad5ead346af94688559f2770cbb'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.945741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4985fad5ead346af94688559f2770cbb'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.946427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4985fad5ead346af94688559f2770cbb'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.956819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4985fad5ead346af94688559f2770cbb'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.962015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83dbf3421ae4229af540fbbc387b7c6', 'request_id': 'req-4d222eec-8469-4912-8248-d15adbd7bd24'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.971006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83dbf3421ae4229af540fbbc387b7c6', 'request_id': 'req-4d222eec-8469-4912-8248-d15adbd7bd24'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.974258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4985fad5ead346af94688559f2770cbb'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:05.980516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83dbf3421ae4229af540fbbc387b7c6', 'request_id': 'req-4d222eec-8469-4912-8248-d15adbd7bd24'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.082608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1016/2067] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:05 2022] DELETE /identity/v3/users/4985fad5ead346af94688559f2770cbb => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:03:06.210039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] The token cache is being invalidate because project a83dbf3421ae4229af540fbbc387b7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:06.211337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.212539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.215421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1052/2068] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:05 2022] DELETE /identity/v3/projects/a83dbf3421ae4229af540fbbc387b7c6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:06.219152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:06.221459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:06.305394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277725-0968-412f-8550-1f10b5f10513 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:06.309747 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:06.312954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:06.313843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:06.314152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:06.314623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] PATH_INFO: `/v3/users/31eab90627e647dd9c7bf1892ea9a0ac` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:06.315885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31eab90627e647dd9c7bf1892ea9a0ac)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:06.319197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:06.560627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31eab90627e647dd9c7bf1892ea9a0ac'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.561355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31eab90627e647dd9c7bf1892ea9a0ac'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.562314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31eab90627e647dd9c7bf1892ea9a0ac'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.581655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31eab90627e647dd9c7bf1892ea9a0ac'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.600237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0cbbd3b6-90cc-4345-9735-f0b675aac348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31eab90627e647dd9c7bf1892ea9a0ac'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.613919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:06.622350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:06.710451 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:06.712637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d222eec-8469-4912-8248-d15adbd7bd24 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:06.720392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:06.721797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:06.722076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:06.722442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] PATH_INFO: `/v3/projects/3de4a7a5e8604121b4d00a128bb6ee61` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:06.724602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de4a7a5e8604121b4d00a128bb6ee61)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:06.727570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:06.737887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1017/2069] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:06 2022] DELETE /identity/v3/users/31eab90627e647dd9c7bf1892ea9a0ac => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:06.737887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde588e1-6114-4a40-bcaf-bfedcd106633 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:06.738592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde588e1-6114-4a40-bcaf-bfedcd106633 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:06.738937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde588e1-6114-4a40-bcaf-bfedcd106633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:06.780492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-bde588e1-6114-4a40-bcaf-bfedcd106633 None None] MFA Rules not processed for user `94954697f2ba4d94bf0b7d55c4c1beb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:06.782226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-bde588e1-6114-4a40-bcaf-bfedcd106633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:06.848930 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1018/2070] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:06.876462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de4a7a5e8604121b4d00a128bb6ee61', 'request_id': 'req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.883733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de4a7a5e8604121b4d00a128bb6ee61', 'request_id': 'req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.891637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de4a7a5e8604121b4d00a128bb6ee61', 'request_id': 'req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.987932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] The token cache is being invalidate because project 3de4a7a5e8604121b4d00a128bb6ee61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:06.988448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.989148 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-40a65fbe-f67a-4a72-9fc8-96110a8ca85d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:06.991278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1053/2071] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:06 2022] DELETE /identity/v3/projects/3de4a7a5e8604121b4d00a128bb6ee61 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:06.997710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91052c-71ff-452c-838e-4e0c939c0abf None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:06.998087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91052c-71ff-452c-838e-4e0c939c0abf None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:06.998437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91052c-71ff-452c-838e-4e0c939c0abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:07.023657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ba91052c-71ff-452c-838e-4e0c939c0abf None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:07.024885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ba91052c-71ff-452c-838e-4e0c939c0abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:07.111795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1019/2072] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:07.117326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522d1b9-48c7-4f2c-ad06-a2487127d2d5 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:07.117589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522d1b9-48c7-4f2c-ad06-a2487127d2d5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:07.121671 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522d1b9-48c7-4f2c-ad06-a2487127d2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:07.145885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-c522d1b9-48c7-4f2c-ad06-a2487127d2d5 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:07.147345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c522d1b9-48c7-4f2c-ad06-a2487127d2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:07.156557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1054/2073] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:07.161046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91052c-71ff-452c-838e-4e0c939c0abf None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:07.171828 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91052c-71ff-452c-838e-4e0c939c0abf None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:07.176828 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16218e-2fd4-4848-9084-352726080032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:07.181371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16218e-2fd4-4848-9084-352726080032 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:07.181371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16218e-2fd4-4848-9084-352726080032 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:07.181371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16218e-2fd4-4848-9084-352726080032 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:07.181371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16218e-2fd4-4848-9084-352726080032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:03:07.181371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16218e-2fd4-4848-9084-352726080032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:07.181371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16218e-2fd4-4848-9084-352726080032 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:07.195990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1020/2074] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:03:07.197209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522d1b9-48c7-4f2c-ad06-a2487127d2d5 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:07.218716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:07.223500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522d1b9-48c7-4f2c-ad06-a2487127d2d5 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:07.229484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfba55-a811-45ff-af84-7a8d336e4a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:07.230516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfba55-a811-45ff-af84-7a8d336e4a96 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:07.231175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfba55-a811-45ff-af84-7a8d336e4a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:07.232883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfba55-a811-45ff-af84-7a8d336e4a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:07.233995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfba55-a811-45ff-af84-7a8d336e4a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:07.236199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfba55-a811-45ff-af84-7a8d336e4a96 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:07.412212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1055/2075] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:03:07 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:07.413808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16218e-2fd4-4848-9084-352726080032 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:07.430799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16218e-2fd4-4848-9084-352726080032 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:07.442548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfba55-a811-45ff-af84-7a8d336e4a96 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:07.446250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-12bfba55-a811-45ff-af84-7a8d336e4a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:07.528101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8284f-f593-46c3-b8a0-8f0cad795d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:07.530658 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8284f-f593-46c3-b8a0-8f0cad795d9d admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:07.530948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8284f-f593-46c3-b8a0-8f0cad795d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:07.531258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8284f-f593-46c3-b8a0-8f0cad795d9d admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:07.531964 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8284f-f593-46c3-b8a0-8f0cad795d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:07.534672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8284f-f593-46c3-b8a0-8f0cad795d9d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:07.584418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfba55-a811-45ff-af84-7a8d336e4a96 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:07.589635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:07.590648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:07.590935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:07.591268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] PATH_INFO: `/v3/projects/b99fb41b3c7b42638c759768d3297d96` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:07.592617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99fb41b3c7b42638c759768d3297d96)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:07.594456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:07.698289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1021/2076] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:03:07 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:07.700710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8284f-f593-46c3-b8a0-8f0cad795d9d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:07.726662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8284f-f593-46c3-b8a0-8f0cad795d9d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:07.748287 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c70b7d-3775-4f09-ba55-6970ca32217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:07.748990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c70b7d-3775-4f09-ba55-6970ca32217c admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:07.749280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c70b7d-3775-4f09-ba55-6970ca32217c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:07.749563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c70b7d-3775-4f09-ba55-6970ca32217c admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:07.750304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c70b7d-3775-4f09-ba55-6970ca32217c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:07.752027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c70b7d-3775-4f09-ba55-6970ca32217c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:07.781033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1022/2077] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:03:07.789954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c70b7d-3775-4f09-ba55-6970ca32217c admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:07.795670 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99fb41b3c7b42638c759768d3297d96', 'request_id': 'req-c2b57de6-62d7-434c-8faf-1bc476087868'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:07.811312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c70b7d-3775-4f09-ba55-6970ca32217c admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:07.812368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99fb41b3c7b42638c759768d3297d96', 'request_id': 'req-c2b57de6-62d7-434c-8faf-1bc476087868'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:07.832251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99fb41b3c7b42638c759768d3297d96', 'request_id': 'req-c2b57de6-62d7-434c-8faf-1bc476087868'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:07.942874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe85f5-41b1-42e8-9ef5-369274ea24f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:07.944046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe85f5-41b1-42e8-9ef5-369274ea24f7 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:07.944523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe85f5-41b1-42e8-9ef5-369274ea24f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:07.945079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe85f5-41b1-42e8-9ef5-369274ea24f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:07.946918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe85f5-41b1-42e8-9ef5-369274ea24f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:07.952500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe85f5-41b1-42e8-9ef5-369274ea24f7 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:07.964659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] The token cache is being invalidate because project b99fb41b3c7b42638c759768d3297d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:07.964659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:07.964659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c2b57de6-62d7-434c-8faf-1bc476087868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:07.966304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1056/2078] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:07 2022] DELETE /identity/v3/projects/b99fb41b3c7b42638c759768d3297d96 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:07.973128 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21b3d3-4803-4fb9-aae4-a15340322db4 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:07.983605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21b3d3-4803-4fb9-aae4-a15340322db4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:07.983605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21b3d3-4803-4fb9-aae4-a15340322db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:07.988276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1023/2079] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:03:08.001488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe85f5-41b1-42e8-9ef5-369274ea24f7 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:08.007555 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-abbe85f5-41b1-42e8-9ef5-369274ea24f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:08.024695 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0f21b3d3-4803-4fb9-aae4-a15340322db4 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:08.026458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0f21b3d3-4803-4fb9-aae4-a15340322db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:08.029362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe85f5-41b1-42e8-9ef5-369274ea24f7 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:08.037180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414bfe0-ec3e-4997-a625-138ad70407e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:08.038353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414bfe0-ec3e-4997-a625-138ad70407e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:08.038612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414bfe0-ec3e-4997-a625-138ad70407e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:08.038889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414bfe0-ec3e-4997-a625-138ad70407e2 admin admin] PATH_INFO: `/v3/projects/7553e30563ef48adae696c1194136e08/users/204a768322694e1687bb57df9f00a81e/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:08.044396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1057/2080] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:08.053296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeb253-6201-4cb1-b253-5cdaa45046a3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:08.053799 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeb253-6201-4cb1-b253-5cdaa45046a3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:08.054083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeb253-6201-4cb1-b253-5cdaa45046a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:08.085321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414bfe0-ec3e-4997-a625-138ad70407e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7553e30563ef48adae696c1194136e08, user_id=204a768322694e1687bb57df9f00a81e, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:08.086144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-e0eeb253-6201-4cb1-b253-5cdaa45046a3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:08.088156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414bfe0-ec3e-4997-a625-138ad70407e2 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:08.095644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-e0eeb253-6201-4cb1-b253-5cdaa45046a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:08.104759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1058/2081] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:08.116906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eeb253-6201-4cb1-b253-5cdaa45046a3 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:08.129005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eeb253-6201-4cb1-b253-5cdaa45046a3 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:08.138924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77102c59-0571-4c37-a6d9-4a08150aa4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:08.138924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102c59-0571-4c37-a6d9-4a08150aa4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:08.138924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102c59-0571-4c37-a6d9-4a08150aa4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:08.138924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77102c59-0571-4c37-a6d9-4a08150aa4f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:08.139380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77102c59-0571-4c37-a6d9-4a08150aa4f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:03:08.139380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77102c59-0571-4c37-a6d9-4a08150aa4f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:08.139380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77102c59-0571-4c37-a6d9-4a08150aa4f7 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:08.155214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1059/2082] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:03:08.159378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77102c59-0571-4c37-a6d9-4a08150aa4f7 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:08.174116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77102c59-0571-4c37-a6d9-4a08150aa4f7 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:08.193409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1024/2083] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:08 2022] PUT /identity/v3/projects/7553e30563ef48adae696c1194136e08/users/204a768322694e1687bb57df9f00a81e/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:08.194250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9f5e8-bbbc-4080-8d86-12942206295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:08.196028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9f5e8-bbbc-4080-8d86-12942206295b admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:08.196523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9f5e8-bbbc-4080-8d86-12942206295b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:08.196832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9f5e8-bbbc-4080-8d86-12942206295b admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:08.197570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9f5e8-bbbc-4080-8d86-12942206295b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:08.200569 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9f5e8-bbbc-4080-8d86-12942206295b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:08.207519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cceb2a-efb2-4e08-bfc9-05fe022e2358 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:08.207763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cceb2a-efb2-4e08-bfc9-05fe022e2358 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:08.207886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cceb2a-efb2-4e08-bfc9-05fe022e2358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:08.238285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-84cceb2a-efb2-4e08-bfc9-05fe022e2358 None None] MFA Rules not processed for user `204a768322694e1687bb57df9f00a81e`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:08.239406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-84cceb2a-efb2-4e08-bfc9-05fe022e2358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:08.312035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1025/2084] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:08.313560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:08.324292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cceb2a-efb2-4e08-bfc9-05fe022e2358 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:08.325738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-84cceb2a-efb2-4e08-bfc9-05fe022e2358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:08.369789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1060/2085] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:03:08 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:08.371533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9f5e8-bbbc-4080-8d86-12942206295b admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:08.445533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cceb2a-efb2-4e08-bfc9-05fe022e2358 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:08.490711 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9f5e8-bbbc-4080-8d86-12942206295b admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:08.497938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb7c3f-a7b9-4a73-bba7-958d266d1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:08.497938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb7c3f-a7b9-4a73-bba7-958d266d1e70 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:08.497938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb7c3f-a7b9-4a73-bba7-958d266d1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:08.497938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb7c3f-a7b9-4a73-bba7-958d266d1e70 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:08.500255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb7c3f-a7b9-4a73-bba7-958d266d1e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:08.501525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb7c3f-a7b9-4a73-bba7-958d266d1e70 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:08.517974 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2451-2eac-4edf-afcf-564b351c66a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:08.518643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2451-2eac-4edf-afcf-564b351c66a4 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:08.518922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2451-2eac-4edf-afcf-564b351c66a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:08.519302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2451-2eac-4edf-afcf-564b351c66a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:08.611105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a2451-2eac-4edf-afcf-564b351c66a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:08.614378 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a2451-2eac-4edf-afcf-564b351c66a4 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:08.637923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1061/2086] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:03:08 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:03:08.639818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb7c3f-a7b9-4a73-bba7-958d266d1e70 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:08.668932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1026/2087] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:03:08.675231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2451-2eac-4edf-afcf-564b351c66a4 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:08.675824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6afb7c3f-a7b9-4a73-bba7-958d266d1e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:08.686561 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2451-2eac-4edf-afcf-564b351c66a4 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:08.693778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce463ce-e399-4522-b42a-3cc6fcbbde13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:08.694482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce463ce-e399-4522-b42a-3cc6fcbbde13 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:08.694776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce463ce-e399-4522-b42a-3cc6fcbbde13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:08.695371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce463ce-e399-4522-b42a-3cc6fcbbde13 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:08.696110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce463ce-e399-4522-b42a-3cc6fcbbde13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:08.698556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce463ce-e399-4522-b42a-3cc6fcbbde13 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:08.716393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1027/2088] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:08.717289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce463ce-e399-4522-b42a-3cc6fcbbde13 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:08.728534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce463ce-e399-4522-b42a-3cc6fcbbde13 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:08.735245 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:08.736720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:08.736836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb7c3f-a7b9-4a73-bba7-958d266d1e70 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:08.736933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:08.736933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] PATH_INFO: `/v3/users/204a768322694e1687bb57df9f00a81e` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:08.738142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=204a768322694e1687bb57df9f00a81e)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:08.742419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:08.744050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:08.745983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:08.746485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:08.746930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] PATH_INFO: `/v3/users/a1d8bdbe76714958805058916440059e` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:08.748681 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d8bdbe76714958805058916440059e)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:08.752352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:09.031348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d8bdbe76714958805058916440059e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:09.032430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d8bdbe76714958805058916440059e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:09.033477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d8bdbe76714958805058916440059e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:09.034607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204a768322694e1687bb57df9f00a81e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:09.035368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204a768322694e1687bb57df9f00a81e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:09.036447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204a768322694e1687bb57df9f00a81e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:09.047557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204a768322694e1687bb57df9f00a81e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:09.062593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad8440fd-7236-42aa-a534-2e4d5fe6afd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204a768322694e1687bb57df9f00a81e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:09.162117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d8bdbe76714958805058916440059e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:09.170298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d8bdbe76714958805058916440059e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:09.192385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1062/2089] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:08 2022] DELETE /identity/v3/users/a1d8bdbe76714958805058916440059e => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:09.193791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:09.195259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:09.247718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:09.281330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1028/2090] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:08 2022] DELETE /identity/v3/users/204a768322694e1687bb57df9f00a81e => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:09.282808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566db7d7-d5ef-443e-8ffc-fb3d665495c6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:09.283056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d625-ff01-4ae0-a57b-75a061e76d1e None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:09.283179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d625-ff01-4ae0-a57b-75a061e76d1e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:09.283556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f662d625-ff01-4ae0-a57b-75a061e76d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:09.309795 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f662d625-ff01-4ae0-a57b-75a061e76d1e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:09.312050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f662d625-ff01-4ae0-a57b-75a061e76d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:09.370262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42824d2d-6ed2-4c34-895b-882e08e8b382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:09.371303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824d2d-6ed2-4c34-895b-882e08e8b382 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:09.371594 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824d2d-6ed2-4c34-895b-882e08e8b382 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:09.371875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42824d2d-6ed2-4c34-895b-882e08e8b382 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:09.373112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42824d2d-6ed2-4c34-895b-882e08e8b382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:09.377136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42824d2d-6ed2-4c34-895b-882e08e8b382 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:09.392325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1063/2091] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:09.393738 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3f3c-05f3-403a-88fd-4b9cbc4d70d1 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:09.394037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3f3c-05f3-403a-88fd-4b9cbc4d70d1 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:09.394356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b3f3c-05f3-403a-88fd-4b9cbc4d70d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:09.418383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-223b3f3c-05f3-403a-88fd-4b9cbc4d70d1 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:09.418844 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-223b3f3c-05f3-403a-88fd-4b9cbc4d70d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:09.423945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1029/2092] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:09.424821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662d625-ff01-4ae0-a57b-75a061e76d1e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:09.427936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f662d625-ff01-4ae0-a57b-75a061e76d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:09.435014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1064/2093] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:09.449236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b3f3c-05f3-403a-88fd-4b9cbc4d70d1 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:09.450656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f662d625-ff01-4ae0-a57b-75a061e76d1e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:09.451152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-223b3f3c-05f3-403a-88fd-4b9cbc4d70d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:09.456298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480dc02-6172-463d-bd84-8930764d3f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:09.457257 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480dc02-6172-463d-bd84-8930764d3f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:09.457546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480dc02-6172-463d-bd84-8930764d3f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:09.457825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480dc02-6172-463d-bd84-8930764d3f82 admin admin] PATH_INFO: `/v3/projects/b2c13a7cd85f420eb577b61fee914e4b/users/0c93496fa01c417298054595724bdaa3/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:09.479970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480dc02-6172-463d-bd84-8930764d3f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c13a7cd85f420eb577b61fee914e4b, user_id=0c93496fa01c417298054595724bdaa3, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:09.483185 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480dc02-6172-463d-bd84-8930764d3f82 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:09.518398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b3f3c-05f3-403a-88fd-4b9cbc4d70d1 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:09.522353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba7fd7-bbbc-4b3f-a673-c0f728ddfdad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:09.523701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba7fd7-bbbc-4b3f-a673-c0f728ddfdad service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:09.524078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba7fd7-bbbc-4b3f-a673-c0f728ddfdad service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:09.524422 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba7fd7-bbbc-4b3f-a673-c0f728ddfdad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:09.536430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba7fd7-bbbc-4b3f-a673-c0f728ddfdad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:09.537637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba7fd7-bbbc-4b3f-a673-c0f728ddfdad service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:09.549161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1065/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:09.550019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba7fd7-bbbc-4b3f-a673-c0f728ddfdad service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:09.551624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-2dba7fd7-bbbc-4b3f-a673-c0f728ddfdad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:09.565363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba7fd7-bbbc-4b3f-a673-c0f728ddfdad service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:09.570368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eea070-efd8-4401-b19a-14ab12ee8ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:09.571851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eea070-efd8-4401-b19a-14ab12ee8ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:09.573487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eea070-efd8-4401-b19a-14ab12ee8ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:09.574574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eea070-efd8-4401-b19a-14ab12ee8ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:09.582480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1030/2095] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:09 2022] PUT /identity/v3/projects/b2c13a7cd85f420eb577b61fee914e4b/users/0c93496fa01c417298054595724bdaa3/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:09.592736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eea070-efd8-4401-b19a-14ab12ee8ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:09.593690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f7ed0-22f9-4d35-9510-888ea91c5c2d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:09.593988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f7ed0-22f9-4d35-9510-888ea91c5c2d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:09.594267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f7ed0-22f9-4d35-9510-888ea91c5c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:09.598797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eea070-efd8-4401-b19a-14ab12ee8ad7 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:09.616213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1066/2096] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:09.642950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-e98f7ed0-22f9-4d35-9510-888ea91c5c2d None None] MFA Rules not processed for user `0c93496fa01c417298054595724bdaa3`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:09.644735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e98f7ed0-22f9-4d35-9510-888ea91c5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:09.746862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1031/2097] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:03:09.770418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eea070-efd8-4401-b19a-14ab12ee8ad7 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:09.772051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a6eea070-efd8-4401-b19a-14ab12ee8ad7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:09.845559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eea070-efd8-4401-b19a-14ab12ee8ad7 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:09.916100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19f464-f12c-46ce-b7d7-a12ddb36a9a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb36541c7ba418a843e5ecbb1f1e337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:09.916867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19f464-f12c-46ce-b7d7-a12ddb36a9a9 service glance] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:09.917168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19f464-f12c-46ce-b7d7-a12ddb36a9a9 service glance] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:09.918048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19f464-f12c-46ce-b7d7-a12ddb36a9a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:09.929972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19f464-f12c-46ce-b7d7-a12ddb36a9a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:09.937515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19f464-f12c-46ce-b7d7-a12ddb36a9a9 service glance] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:09.952066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1067/2098] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:03:10.499205 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f7ed0-22f9-4d35-9510-888ea91c5c2d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:10.501127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e98f7ed0-22f9-4d35-9510-888ea91c5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:10.514579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19f464-f12c-46ce-b7d7-a12ddb36a9a9 service glance] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:10.517103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bd19f464-f12c-46ce-b7d7-a12ddb36a9a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:10.608810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f7ed0-22f9-4d35-9510-888ea91c5c2d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:10.609054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19f464-f12c-46ce-b7d7-a12ddb36a9a9 service glance] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:10.614184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:10.615429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:10.615604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:10.615791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:10.622053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] PATH_INFO: `/v3/projects/7553e30563ef48adae696c1194136e08` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:10.622274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:10.622274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:10.622274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] PATH_INFO: `/v3/projects/c2d04d00f0b84050a77986f80e11c44b` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:10.622717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7553e30563ef48adae696c1194136e08)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:10.622886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d04d00f0b84050a77986f80e11c44b)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:10.623070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:10.623213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:10.624293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:10.763361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d04d00f0b84050a77986f80e11c44b', 'request_id': 'req-62bbabb3-10a6-47f0-8c08-314f234bc90e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:10.769730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7553e30563ef48adae696c1194136e08', 'request_id': 'req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:10.774956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d04d00f0b84050a77986f80e11c44b', 'request_id': 'req-62bbabb3-10a6-47f0-8c08-314f234bc90e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:10.795603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7553e30563ef48adae696c1194136e08', 'request_id': 'req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:10.799091 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d04d00f0b84050a77986f80e11c44b', 'request_id': 'req-62bbabb3-10a6-47f0-8c08-314f234bc90e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:10.806739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7553e30563ef48adae696c1194136e08', 'request_id': 'req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:10.907973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] The token cache is being invalidate because project c2d04d00f0b84050a77986f80e11c44b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:10.908293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:10.909353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:10.910861 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1068/2099] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:10 2022] DELETE /identity/v3/projects/c2d04d00f0b84050a77986f80e11c44b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:10.914585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:10.916000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:10.987786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbabb3-10a6-47f0-8c08-314f234bc90e admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:11.042748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] The token cache is being invalidate because project 7553e30563ef48adae696c1194136e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:11.043339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:11.044388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f1bc0ff9-fc59-416a-bda8-90e4cfb02d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:11.054285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1032/2100] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:10 2022] DELETE /identity/v3/projects/7553e30563ef48adae696c1194136e08 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:11.055327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee94da5-b981-475b-901d-431ec98896df None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:11.055620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee94da5-b981-475b-901d-431ec98896df None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:11.055897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee94da5-b981-475b-901d-431ec98896df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:11.070388 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:11.072343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:11.072734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:11.073087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] PATH_INFO: `/v3/users/92b381ccf4064587b474f4ef78be423c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:11.074944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b381ccf4064587b474f4ef78be423c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:11.077360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:11.099079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-0ee94da5-b981-475b-901d-431ec98896df None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:11.100889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0ee94da5-b981-475b-901d-431ec98896df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:11.112357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1033/2101] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:03:11.121176 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21977872-de3e-4c90-a3c1-0b8253695fc7 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:11.121816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21977872-de3e-4c90-a3c1-0b8253695fc7 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:11.122361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21977872-de3e-4c90-a3c1-0b8253695fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:11.148084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-21977872-de3e-4c90-a3c1-0b8253695fc7 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:11.160726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-21977872-de3e-4c90-a3c1-0b8253695fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:11.187133 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1034/2102] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:11.193459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21977872-de3e-4c90-a3c1-0b8253695fc7 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:11.213058 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21977872-de3e-4c90-a3c1-0b8253695fc7 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:11.229529 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412961-df71-4c8d-8f1d-cdfbc21aaf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:11.230222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412961-df71-4c8d-8f1d-cdfbc21aaf49 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:11.236661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412961-df71-4c8d-8f1d-cdfbc21aaf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:11.236661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e412961-df71-4c8d-8f1d-cdfbc21aaf49 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:11.236661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412961-df71-4c8d-8f1d-cdfbc21aaf49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:03:11.236661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412961-df71-4c8d-8f1d-cdfbc21aaf49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:11.236661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e412961-df71-4c8d-8f1d-cdfbc21aaf49 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:11.253258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1035/2103] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:03:11.254203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412961-df71-4c8d-8f1d-cdfbc21aaf49 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:11.270284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e412961-df71-4c8d-8f1d-cdfbc21aaf49 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:11.275221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ba33d-f75a-48bc-85c0-6c026a5bd4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:11.276847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ba33d-f75a-48bc-85c0-6c026a5bd4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:11.277194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ba33d-f75a-48bc-85c0-6c026a5bd4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:11.277558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ba33d-f75a-48bc-85c0-6c026a5bd4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:11.278316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ba33d-f75a-48bc-85c0-6c026a5bd4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:11.280330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ba33d-f75a-48bc-85c0-6c026a5bd4b4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:11.405410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b381ccf4064587b474f4ef78be423c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:11.406158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b381ccf4064587b474f4ef78be423c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:11.407049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b381ccf4064587b474f4ef78be423c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:11.460144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1036/2104] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:03:11 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:11.464685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ba33d-f75a-48bc-85c0-6c026a5bd4b4 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:11.466444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4e4ba33d-f75a-48bc-85c0-6c026a5bd4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:11.481943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b381ccf4064587b474f4ef78be423c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:11.490364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b381ccf4064587b474f4ef78be423c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:11.512690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1069/2105] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:10 2022] DELETE /identity/v3/users/92b381ccf4064587b474f4ef78be423c => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:11.540171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ba33d-f75a-48bc-85c0-6c026a5bd4b4 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:11.610496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e29be-d98a-4392-ae25-df08aba2c0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:11.611478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e29be-d98a-4392-ae25-df08aba2c0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:11.611888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e29be-d98a-4392-ae25-df08aba2c0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:11.612363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e29be-d98a-4392-ae25-df08aba2c0a2 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:11.613231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e29be-d98a-4392-ae25-df08aba2c0a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:11.615447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e29be-d98a-4392-ae25-df08aba2c0a2 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:11.745841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:11.755486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1037/2106] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:03:11 2022] POST /identity/v3/users => generated 287 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:03:11.756945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:11.772726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc090be-e456-4d45-b341-166050830061 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:11.788626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa68859-9f87-4e26-9639-2a0d43defbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:11.789509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa68859-9f87-4e26-9639-2a0d43defbaa admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:11.789744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa68859-9f87-4e26-9639-2a0d43defbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:11.790027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa68859-9f87-4e26-9639-2a0d43defbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:11.790767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa68859-9f87-4e26-9639-2a0d43defbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:11.793614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa68859-9f87-4e26-9639-2a0d43defbaa admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:11.834140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1070/2107] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:11.834382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e29be-d98a-4392-ae25-df08aba2c0a2 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:11.847921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e29be-d98a-4392-ae25-df08aba2c0a2 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:11.855626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fa359-1ad5-4ad3-bd6c-a2fc03c72069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:11.857219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fa359-1ad5-4ad3-bd6c-a2fc03c72069 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:11.857507 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fa359-1ad5-4ad3-bd6c-a2fc03c72069 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:11.857809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fa359-1ad5-4ad3-bd6c-a2fc03c72069 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:11.858558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fa359-1ad5-4ad3-bd6c-a2fc03c72069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:11.861050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fa359-1ad5-4ad3-bd6c-a2fc03c72069 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:11.878237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa68859-9f87-4e26-9639-2a0d43defbaa admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:11.887095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1038/2108] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:03:11.893776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa68859-9f87-4e26-9639-2a0d43defbaa admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:11.899995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6f33-8f56-437a-b76f-cf4b7c9c8cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:11.902028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6f33-8f56-437a-b76f-cf4b7c9c8cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:11.902292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6f33-8f56-437a-b76f-cf4b7c9c8cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:11.902563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6f33-8f56-437a-b76f-cf4b7c9c8cd5 admin admin] PATH_INFO: `/v3/projects/74c2578a5b794b19a55be8c1953cdc16/users/34fa06cb686e46bdb8d41b4f6f8f1bf0/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:11.935281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e6f33-8f56-437a-b76f-cf4b7c9c8cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74c2578a5b794b19a55be8c1953cdc16, user_id=34fa06cb686e46bdb8d41b4f6f8f1bf0, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:11.938339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e6f33-8f56-437a-b76f-cf4b7c9c8cd5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:12.025047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1071/2109] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:11 2022] PUT /identity/v3/projects/74c2578a5b794b19a55be8c1953cdc16/users/34fa06cb686e46bdb8d41b4f6f8f1bf0/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:12.038082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48245195-de44-4f61-ab89-40858da7388c None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:12.038374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48245195-de44-4f61-ab89-40858da7388c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:12.038654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48245195-de44-4f61-ab89-40858da7388c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:12.072321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-48245195-de44-4f61-ab89-40858da7388c None None] MFA Rules not processed for user `34fa06cb686e46bdb8d41b4f6f8f1bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:12.075042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-48245195-de44-4f61-ab89-40858da7388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:12.168478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1039/2110] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:12.178834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6f33-8f56-437a-b76f-cf4b7c9c8cd5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:12.181114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0e9e6f33-8f56-437a-b76f-cf4b7c9c8cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:12.185106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:12.250271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:12.265525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6f33-8f56-437a-b76f-cf4b7c9c8cd5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:12.269522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b344c-95dd-44b8-bd1a-32d43ea45dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:12.270340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b344c-95dd-44b8-bd1a-32d43ea45dce service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:12.270630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b344c-95dd-44b8-bd1a-32d43ea45dce service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:12.270905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b344c-95dd-44b8-bd1a-32d43ea45dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:12.281616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b344c-95dd-44b8-bd1a-32d43ea45dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:12.283096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b344c-95dd-44b8-bd1a-32d43ea45dce service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:12.294362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1072/2111] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:12.543311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48245195-de44-4f61-ab89-40858da7388c None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:12.544838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-48245195-de44-4f61-ab89-40858da7388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:12.656386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48245195-de44-4f61-ab89-40858da7388c None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:12.674650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:12.678265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:12.678265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:12.679465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] PATH_INFO: `/v3/projects/5ea629c6938a41649381a61ed728f6f7` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:12.681516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea629c6938a41649381a61ed728f6f7)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:12.684985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:12.773862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:12.890703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea629c6938a41649381a61ed728f6f7', 'request_id': 'req-28775d06-00fa-4d66-ae7f-31fe070046fa'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:12.897725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea629c6938a41649381a61ed728f6f7', 'request_id': 'req-28775d06-00fa-4d66-ae7f-31fe070046fa'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:12.905812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea629c6938a41649381a61ed728f6f7', 'request_id': 'req-28775d06-00fa-4d66-ae7f-31fe070046fa'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:13.023296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] The token cache is being invalidate because project 5ea629c6938a41649381a61ed728f6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:13.023600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:13.024255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28775d06-00fa-4d66-ae7f-31fe070046fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:13.026512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1040/2112] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:12 2022] DELETE /identity/v3/projects/5ea629c6938a41649381a61ed728f6f7 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:03:13.031785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a8713-a264-4ec5-86b7-4ee57d1f0b8e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:13.042603 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a8713-a264-4ec5-86b7-4ee57d1f0b8e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:13.042896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a8713-a264-4ec5-86b7-4ee57d1f0b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:13.088801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a41a8713-a264-4ec5-86b7-4ee57d1f0b8e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:13.090430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a41a8713-a264-4ec5-86b7-4ee57d1f0b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:13.108344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:13.238664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1073/2113] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:13.246623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06370326-a4d5-438a-b492-eb6359bf6f11 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:13.246925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06370326-a4d5-438a-b492-eb6359bf6f11 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:13.247218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06370326-a4d5-438a-b492-eb6359bf6f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:13.298148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-06370326-a4d5-438a-b492-eb6359bf6f11 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:13.302259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-06370326-a4d5-438a-b492-eb6359bf6f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:13.312870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1041/2114] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:13.317231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a8713-a264-4ec5-86b7-4ee57d1f0b8e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:13.334236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a8713-a264-4ec5-86b7-4ee57d1f0b8e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:13.350368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad22b-f96c-4462-af3d-1e5dce7734b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:13.350368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad22b-f96c-4462-af3d-1e5dce7734b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:13.350368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad22b-f96c-4462-af3d-1e5dce7734b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:13.350368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad22b-f96c-4462-af3d-1e5dce7734b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:13.350832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dad22b-f96c-4462-af3d-1e5dce7734b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:03:13.350832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dad22b-f96c-4462-af3d-1e5dce7734b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:13.354680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dad22b-f96c-4462-af3d-1e5dce7734b4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:13.390729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1074/2115] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:03:13.392360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06370326-a4d5-438a-b492-eb6359bf6f11 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:13.402910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06370326-a4d5-438a-b492-eb6359bf6f11 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:13.407753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d8a92-ef26-4b1f-9848-a70187534119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:13.408782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d8a92-ef26-4b1f-9848-a70187534119 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:13.409390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d8a92-ef26-4b1f-9848-a70187534119 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:13.409845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d8a92-ef26-4b1f-9848-a70187534119 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:13.410750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d8a92-ef26-4b1f-9848-a70187534119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:13.413607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d8a92-ef26-4b1f-9848-a70187534119 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:13.435613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:13.512582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1042/2116] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:03:13 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:03:13.516856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad22b-f96c-4462-af3d-1e5dce7734b4 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:13.528764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad22b-f96c-4462-af3d-1e5dce7734b4 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:13.595850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee12be-9c66-4161-94e5-1257353a6d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:13.596527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee12be-9c66-4161-94e5-1257353a6d1a admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:13.596811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee12be-9c66-4161-94e5-1257353a6d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:13.597089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee12be-9c66-4161-94e5-1257353a6d1a admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:13.597776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee12be-9c66-4161-94e5-1257353a6d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:13.599834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee12be-9c66-4161-94e5-1257353a6d1a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:13.678889 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1075/2117] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:03:13 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:03:13.683531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d8a92-ef26-4b1f-9848-a70187534119 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:13.701694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d8a92-ef26-4b1f-9848-a70187534119 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:13.710505 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96153ef-ae88-4c1a-a6f2-4d284d1e851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:13.714654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96153ef-ae88-4c1a-a6f2-4d284d1e851d admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:13.714654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96153ef-ae88-4c1a-a6f2-4d284d1e851d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:13.714654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96153ef-ae88-4c1a-a6f2-4d284d1e851d admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:13.714654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96153ef-ae88-4c1a-a6f2-4d284d1e851d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:13.719225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96153ef-ae88-4c1a-a6f2-4d284d1e851d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:13.742879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1043/2118] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:03:13.747149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee12be-9c66-4161-94e5-1257353a6d1a admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:13.761720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee12be-9c66-4161-94e5-1257353a6d1a admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:13.769986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77387d3-f7e9-4975-9660-f0ccc8d0a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:13.771077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77387d3-f7e9-4975-9660-f0ccc8d0a7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:13.772149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77387d3-f7e9-4975-9660-f0ccc8d0a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:13.772149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77387d3-f7e9-4975-9660-f0ccc8d0a7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:13.777047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77387d3-f7e9-4975-9660-f0ccc8d0a7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:13.779639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77387d3-f7e9-4975-9660-f0ccc8d0a7a0 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:13.801240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1076/2119] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:13.802916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96153ef-ae88-4c1a-a6f2-4d284d1e851d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:13.821562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96153ef-ae88-4c1a-a6f2-4d284d1e851d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:13.827830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eabc4-1f34-4799-ada1-2d02b51f44fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:13.828865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eabc4-1f34-4799-ada1-2d02b51f44fe admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:13.830353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eabc4-1f34-4799-ada1-2d02b51f44fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:13.830664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eabc4-1f34-4799-ada1-2d02b51f44fe admin admin] PATH_INFO: `/v3/projects/3750d15d40914174bbce730252010db4/users/2eae5fabd71b46ff831fb32cb76b9b2d/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:13.849151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074eabc4-1f34-4799-ada1-2d02b51f44fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3750d15d40914174bbce730252010db4, user_id=2eae5fabd71b46ff831fb32cb76b9b2d, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:13.852789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074eabc4-1f34-4799-ada1-2d02b51f44fe admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:13.961834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1044/2120] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:13 2022] PUT /identity/v3/projects/3750d15d40914174bbce730252010db4/users/2eae5fabd71b46ff831fb32cb76b9b2d/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:13.972691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37501d80-f948-4dc0-995e-1eb77b0d3d9f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:13.972934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37501d80-f948-4dc0-995e-1eb77b0d3d9f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:13.973188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37501d80-f948-4dc0-995e-1eb77b0d3d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:13.996218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:14.006813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-37501d80-f948-4dc0-995e-1eb77b0d3d9f None None] MFA Rules not processed for user `2eae5fabd71b46ff831fb32cb76b9b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:14.015542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-37501d80-f948-4dc0-995e-1eb77b0d3d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:14.074715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1077/2121] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:14.079331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eabc4-1f34-4799-ada1-2d02b51f44fe admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:14.145252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eabc4-1f34-4799-ada1-2d02b51f44fe admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:14.150009 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4353b-245b-48f9-8c7f-d2dd67fb9807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:14.150709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4353b-245b-48f9-8c7f-d2dd67fb9807 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:14.151624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4353b-245b-48f9-8c7f-d2dd67fb9807 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:14.151624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4353b-245b-48f9-8c7f-d2dd67fb9807 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:14.152247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4353b-245b-48f9-8c7f-d2dd67fb9807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:14.154194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4353b-245b-48f9-8c7f-d2dd67fb9807 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:14.289027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1045/2122] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:03:14 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:14.290155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37501d80-f948-4dc0-995e-1eb77b0d3d9f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:14.304287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37501d80-f948-4dc0-995e-1eb77b0d3d9f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:14.379203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0483-c698-47eb-ab26-eb41ec43782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:14.380354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0483-c698-47eb-ab26-eb41ec43782f admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:14.380692 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0483-c698-47eb-ab26-eb41ec43782f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:14.380972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb0483-c698-47eb-ab26-eb41ec43782f admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:14.381867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb0483-c698-47eb-ab26-eb41ec43782f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:14.384178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb0483-c698-47eb-ab26-eb41ec43782f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:14.472016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1078/2123] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:03:14 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:03:14.474045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4353b-245b-48f9-8c7f-d2dd67fb9807 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:14.486531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4353b-245b-48f9-8c7f-d2dd67fb9807 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:14.492276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9c9f1-f4f7-436c-9f5d-2bd50e0ddd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:14.492959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9c9f1-f4f7-436c-9f5d-2bd50e0ddd0d admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:14.493244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9c9f1-f4f7-436c-9f5d-2bd50e0ddd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:14.493521 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9c9f1-f4f7-436c-9f5d-2bd50e0ddd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:14.494329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9c9f1-f4f7-436c-9f5d-2bd50e0ddd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:14.496376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9c9f1-f4f7-436c-9f5d-2bd50e0ddd0d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:14.507322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1046/2124] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:03:14.511817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0483-c698-47eb-ab26-eb41ec43782f admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:14.521829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb0483-c698-47eb-ab26-eb41ec43782f admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:14.527462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f43116-a3fc-440d-918a-16cae27ac6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:14.528380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f43116-a3fc-440d-918a-16cae27ac6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:14.528657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f43116-a3fc-440d-918a-16cae27ac6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:14.528950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f43116-a3fc-440d-918a-16cae27ac6d8 admin admin] PATH_INFO: `/v3/projects/a2b902f0ad294c28a005fe657ac722af/users/63be04cdfcb74171960aa10e5f364dd7/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:14.545974 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f43116-a3fc-440d-918a-16cae27ac6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b902f0ad294c28a005fe657ac722af, user_id=63be04cdfcb74171960aa10e5f364dd7, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:14.548696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f43116-a3fc-440d-918a-16cae27ac6d8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:14.641403 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1079/2125] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:14 2022] PUT /identity/v3/projects/a2b902f0ad294c28a005fe657ac722af/users/63be04cdfcb74171960aa10e5f364dd7/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:14.645387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9c9f1-f4f7-436c-9f5d-2bd50e0ddd0d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:14.656181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9c9f1-f4f7-436c-9f5d-2bd50e0ddd0d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:14.718257 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa4f29-a207-47ab-85d2-ff540b2863f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:14.719131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4f29-a207-47ab-85d2-ff540b2863f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:14.719493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4f29-a207-47ab-85d2-ff540b2863f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:14.719911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa4f29-a207-47ab-85d2-ff540b2863f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:14.720786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa4f29-a207-47ab-85d2-ff540b2863f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:14.722908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa4f29-a207-47ab-85d2-ff540b2863f9 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:14.734771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1047/2126] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:14.738605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f43116-a3fc-440d-918a-16cae27ac6d8 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:14.749154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f43116-a3fc-440d-918a-16cae27ac6d8 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:14.753873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352716-1863-4a19-9667-82bd77b62627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:14.754753 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352716-1863-4a19-9667-82bd77b62627 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:14.755068 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352716-1863-4a19-9667-82bd77b62627 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:14.755343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0352716-1863-4a19-9667-82bd77b62627 admin admin] PATH_INFO: `/v3/projects/a2b902f0ad294c28a005fe657ac722af/users/63be04cdfcb74171960aa10e5f364dd7/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:14.757335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0352716-1863-4a19-9667-82bd77b62627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b902f0ad294c28a005fe657ac722af, user_id=63be04cdfcb74171960aa10e5f364dd7, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:14.760648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0352716-1863-4a19-9667-82bd77b62627 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:14.779253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1080/2127] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:14 2022] PUT /identity/v3/projects/a2b902f0ad294c28a005fe657ac722af/users/63be04cdfcb74171960aa10e5f364dd7/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:14.785914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565486b-2a0d-4678-b6b2-171b0b451440 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:14.785914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565486b-2a0d-4678-b6b2-171b0b451440 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:14.786092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565486b-2a0d-4678-b6b2-171b0b451440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:14.815278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f565486b-2a0d-4678-b6b2-171b0b451440 None None] MFA Rules not processed for user `63be04cdfcb74171960aa10e5f364dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:14.816617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f565486b-2a0d-4678-b6b2-171b0b451440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:14.845394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:14.888522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1048/2128] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:03:14.899967 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352716-1863-4a19-9667-82bd77b62627 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:14.902513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d0352716-1863-4a19-9667-82bd77b62627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:14.960383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0352716-1863-4a19-9667-82bd77b62627 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:14.964990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb135b2f-7c5d-4290-b38b-3b7d0b08a7ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:14.965638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb135b2f-7c5d-4290-b38b-3b7d0b08a7ea service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:14.965925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb135b2f-7c5d-4290-b38b-3b7d0b08a7ea service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:14.966205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb135b2f-7c5d-4290-b38b-3b7d0b08a7ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:14.975243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb135b2f-7c5d-4290-b38b-3b7d0b08a7ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:14.976608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb135b2f-7c5d-4290-b38b-3b7d0b08a7ea service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:14.986364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1081/2129] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:15.061325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:15.527605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:15.938193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:16.069252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565486b-2a0d-4678-b6b2-171b0b451440 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:16.135238 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565486b-2a0d-4678-b6b2-171b0b451440 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:16.139985 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:16.140873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:16.146662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:16.146662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] PATH_INFO: `/v3/users/2eae5fabd71b46ff831fb32cb76b9b2d` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:16.146662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eae5fabd71b46ff831fb32cb76b9b2d)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:16.146662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:16.427034 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eae5fabd71b46ff831fb32cb76b9b2d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:16.427922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eae5fabd71b46ff831fb32cb76b9b2d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:16.428535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eae5fabd71b46ff831fb32cb76b9b2d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:16.435403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eae5fabd71b46ff831fb32cb76b9b2d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:16.447941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eae5fabd71b46ff831fb32cb76b9b2d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:16.557318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1049/2130] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:16 2022] DELETE /identity/v3/users/2eae5fabd71b46ff831fb32cb76b9b2d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:16.561686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e954a1-a924-42cd-84dc-17c646404cc9 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:16.562204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e954a1-a924-42cd-84dc-17c646404cc9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:16.562204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e954a1-a924-42cd-84dc-17c646404cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:16.580980 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-74e954a1-a924-42cd-84dc-17c646404cc9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:16.582097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-74e954a1-a924-42cd-84dc-17c646404cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:16.644599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1082/2131] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:16.654529 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:16.655961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:16.717526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad98f9-b886-402e-a2e1-84c64771794f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:16.721574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ac33e-e534-4d9c-9efa-f162f0eb951a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:16.722219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ac33e-e534-4d9c-9efa-f162f0eb951a service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:16.722499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ac33e-e534-4d9c-9efa-f162f0eb951a service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:16.722775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ac33e-e534-4d9c-9efa-f162f0eb951a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:16.732384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ac33e-e534-4d9c-9efa-f162f0eb951a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:16.733820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135ac33e-e534-4d9c-9efa-f162f0eb951a service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:16.743442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1050/2132] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:17.095873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:17.452989 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:17.577724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e954a1-a924-42cd-84dc-17c646404cc9 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:17.579390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-74e954a1-a924-42cd-84dc-17c646404cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:17.593648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e954a1-a924-42cd-84dc-17c646404cc9 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:17.598276 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:17.599199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:17.599495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:17.599788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] PATH_INFO: `/v3/projects/3750d15d40914174bbce730252010db4` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:17.602268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3750d15d40914174bbce730252010db4)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:17.605722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:17.642394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:17.765570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3750d15d40914174bbce730252010db4', 'request_id': 'req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:17.771805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3750d15d40914174bbce730252010db4', 'request_id': 'req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:17.785115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3750d15d40914174bbce730252010db4', 'request_id': 'req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:17.864956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ac33e-e534-4d9c-9efa-f162f0eb951a service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:17.866371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-135ac33e-e534-4d9c-9efa-f162f0eb951a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:17.880219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ac33e-e534-4d9c-9efa-f162f0eb951a service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:17.910582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] The token cache is being invalidate because project 3750d15d40914174bbce730252010db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:17.910873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:17.911556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:17.915082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1083/2133] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:17 2022] DELETE /identity/v3/projects/3750d15d40914174bbce730252010db4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:17.919015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:17.921897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:17.974462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:17.975889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:17.976395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:17.976755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] PATH_INFO: `/v3/users/34fa06cb686e46bdb8d41b4f6f8f1bf0` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:17.978407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fa06cb686e46bdb8d41b4f6f8f1bf0)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:17.982313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:18.004301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e873a3-9ff9-4d3e-96d5-afb1253ab99f admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:18.010452 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:18.011813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:18.011813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:18.012017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] PATH_INFO: `/v3/users/63be04cdfcb74171960aa10e5f364dd7` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:18.013626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63be04cdfcb74171960aa10e5f364dd7)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:18.015889 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:18.234390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fa06cb686e46bdb8d41b4f6f8f1bf0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:18.235361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63be04cdfcb74171960aa10e5f364dd7'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:18.235631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fa06cb686e46bdb8d41b4f6f8f1bf0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:18.236151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63be04cdfcb74171960aa10e5f364dd7'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:18.237019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63be04cdfcb74171960aa10e5f364dd7'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:18.237157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fa06cb686e46bdb8d41b4f6f8f1bf0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:18.250144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fa06cb686e46bdb8d41b4f6f8f1bf0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:18.264358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fa06cb686e46bdb8d41b4f6f8f1bf0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:18.355758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63be04cdfcb74171960aa10e5f364dd7'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:18.364897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-becf7dd6-20e8-4ab5-b69f-59a648179340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63be04cdfcb74171960aa10e5f364dd7'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:18.382280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1084/2134] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:17 2022] DELETE /identity/v3/users/63be04cdfcb74171960aa10e5f364dd7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:03:18.444908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1051/2135] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:17 2022] DELETE /identity/v3/users/34fa06cb686e46bdb8d41b4f6f8f1bf0 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:03:18.447930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3ff47-12d3-4ca4-ab2f-cceeb220b636 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:18.448101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3ff47-12d3-4ca4-ab2f-cceeb220b636 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:18.448469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3ff47-12d3-4ca4-ab2f-cceeb220b636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:18.470434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-c4d3ff47-12d3-4ca4-ab2f-cceeb220b636 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:18.471917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c4d3ff47-12d3-4ca4-ab2f-cceeb220b636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:18.504974 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:18.556159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1085/2136] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:03:18.562940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:18.564620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:18.650106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38012ee9-379c-4f0b-a7c2-92dece613920 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:18.656908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e429-d456-43db-9c4e-c8fd9af59cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:18.657580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e429-d456-43db-9c4e-c8fd9af59cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:18.657862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e429-d456-43db-9c4e-c8fd9af59cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:18.658135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e429-d456-43db-9c4e-c8fd9af59cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:18.668938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79e429-d456-43db-9c4e-c8fd9af59cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:18.670398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79e429-d456-43db-9c4e-c8fd9af59cd6 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:18.675699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:18.683617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1052/2137] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:18.973688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3ff47-12d3-4ca4-ab2f-cceeb220b636 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:18.977704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c4d3ff47-12d3-4ca4-ab2f-cceeb220b636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:18.988161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3ff47-12d3-4ca4-ab2f-cceeb220b636 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:18.993669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:18.995296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:18.995472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:18.996511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] PATH_INFO: `/v3/projects/a2b902f0ad294c28a005fe657ac722af` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:18.997475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b902f0ad294c28a005fe657ac722af)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:18.999453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:19.161585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b902f0ad294c28a005fe657ac722af', 'request_id': 'req-bc6646fd-8c25-492c-b808-771e7e545617'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:19.168546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b902f0ad294c28a005fe657ac722af', 'request_id': 'req-bc6646fd-8c25-492c-b808-771e7e545617'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:19.175190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b902f0ad294c28a005fe657ac722af', 'request_id': 'req-bc6646fd-8c25-492c-b808-771e7e545617'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:19.225862 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e429-d456-43db-9c4e-c8fd9af59cd6 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:19.227330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ff79e429-d456-43db-9c4e-c8fd9af59cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:19.243948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e429-d456-43db-9c4e-c8fd9af59cd6 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:19.305266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:19.306121 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:19.306401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:19.306761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] PATH_INFO: `/v3/projects/74c2578a5b794b19a55be8c1953cdc16` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:19.308690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74c2578a5b794b19a55be8c1953cdc16)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:19.310604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:19.320495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] The token cache is being invalidate because project a2b902f0ad294c28a005fe657ac722af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:19.320900 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:19.321536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bc6646fd-8c25-492c-b808-771e7e545617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:19.324508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1086/2138] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:18 2022] DELETE /identity/v3/projects/a2b902f0ad294c28a005fe657ac722af => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:19.334229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18a71e-11b4-4fe9-bf61-8339ff2d9c27 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:19.334481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18a71e-11b4-4fe9-bf61-8339ff2d9c27 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:19.334766 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18a71e-11b4-4fe9-bf61-8339ff2d9c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:19.352944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-dc18a71e-11b4-4fe9-bf61-8339ff2d9c27 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:19.355015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-dc18a71e-11b4-4fe9-bf61-8339ff2d9c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:19.362940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1087/2139] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:19.371660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15987b2-8b61-4a5b-b72b-88a784eaca4f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:19.372072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15987b2-8b61-4a5b-b72b-88a784eaca4f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:19.372366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15987b2-8b61-4a5b-b72b-88a784eaca4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:19.391535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b15987b2-8b61-4a5b-b72b-88a784eaca4f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:19.392738 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b15987b2-8b61-4a5b-b72b-88a784eaca4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:19.401206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1088/2140] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:03:19.405175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15987b2-8b61-4a5b-b72b-88a784eaca4f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:19.414128 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15987b2-8b61-4a5b-b72b-88a784eaca4f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:19.419565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4673d5c-c058-4e58-a72b-bb233251b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:19.420448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4673d5c-c058-4e58-a72b-bb233251b620 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:19.420763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4673d5c-c058-4e58-a72b-bb233251b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:19.421150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4673d5c-c058-4e58-a72b-bb233251b620 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:19.421996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4673d5c-c058-4e58-a72b-bb233251b620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:03:19.422324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4673d5c-c058-4e58-a72b-bb233251b620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:19.424131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4673d5c-c058-4e58-a72b-bb233251b620 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:19.437183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1089/2141] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:03:19.440937 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4673d5c-c058-4e58-a72b-bb233251b620 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:19.451124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4673d5c-c058-4e58-a72b-bb233251b620 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:19.456764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74c2578a5b794b19a55be8c1953cdc16', 'request_id': 'req-633b6233-7ec4-4e1a-9188-bbeadf6ae664'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:19.462353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74c2578a5b794b19a55be8c1953cdc16', 'request_id': 'req-633b6233-7ec4-4e1a-9188-bbeadf6ae664'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:19.468994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74c2578a5b794b19a55be8c1953cdc16', 'request_id': 'req-633b6233-7ec4-4e1a-9188-bbeadf6ae664'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:19.509378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff101e-3558-4525-8b75-4536fac7ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:19.510146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff101e-3558-4525-8b75-4536fac7ded6 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:19.510431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff101e-3558-4525-8b75-4536fac7ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:19.510713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff101e-3558-4525-8b75-4536fac7ded6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:19.511446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff101e-3558-4525-8b75-4536fac7ded6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:19.513383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff101e-3558-4525-8b75-4536fac7ded6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:19.560464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] The token cache is being invalidate because project 74c2578a5b794b19a55be8c1953cdc16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:19.560756 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:19.561387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:19.562948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1053/2142] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:19 2022] DELETE /identity/v3/projects/74c2578a5b794b19a55be8c1953cdc16 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:03:19.695421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1090/2143] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:03:19 2022] POST /identity/v3/projects => generated 361 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:19.700080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:19.702569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:19.728992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b6233-7ec4-4e1a-9188-bbeadf6ae664 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:19.808265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aac62-57a7-4793-8f56-c95adbafb9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:19.808962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aac62-57a7-4793-8f56-c95adbafb9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:19.809248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aac62-57a7-4793-8f56-c95adbafb9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:19.809529 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aac62-57a7-4793-8f56-c95adbafb9c7 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:19.810225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57aac62-57a7-4793-8f56-c95adbafb9c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:19.812491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57aac62-57a7-4793-8f56-c95adbafb9c7 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:19.915663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1054/2144] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:03:19 2022] POST /identity/v3/users => generated 281 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:19.920472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff101e-3558-4525-8b75-4536fac7ded6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:19.931067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff101e-3558-4525-8b75-4536fac7ded6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:19.937103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcacc43-4269-4f06-89a7-91adb7a3136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:19.937836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcacc43-4269-4f06-89a7-91adb7a3136f admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:19.938120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcacc43-4269-4f06-89a7-91adb7a3136f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:19.938446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcacc43-4269-4f06-89a7-91adb7a3136f admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:19.939209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcacc43-4269-4f06-89a7-91adb7a3136f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:19.940868 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcacc43-4269-4f06-89a7-91adb7a3136f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:19.951799 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1091/2145] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:19.967090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aac62-57a7-4793-8f56-c95adbafb9c7 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:19.977528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aac62-57a7-4793-8f56-c95adbafb9c7 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:19.983470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6aaa6-6471-4947-85af-a32ea8d15447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:19.984163 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6aaa6-6471-4947-85af-a32ea8d15447 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:19.984447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6aaa6-6471-4947-85af-a32ea8d15447 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:19.984722 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6aaa6-6471-4947-85af-a32ea8d15447 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:19.985499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6aaa6-6471-4947-85af-a32ea8d15447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:19.987268 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6aaa6-6471-4947-85af-a32ea8d15447 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:19.998889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1055/2146] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:20.004087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcacc43-4269-4f06-89a7-91adb7a3136f admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:20.014384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcacc43-4269-4f06-89a7-91adb7a3136f admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:20.018884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e5993-370f-4401-b999-793186dd20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:20.022742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e5993-370f-4401-b999-793186dd20b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:20.022742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e5993-370f-4401-b999-793186dd20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:20.022742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e5993-370f-4401-b999-793186dd20b3 admin admin] PATH_INFO: `/v3/projects/6dd5fe4fff384e1f907e3fc39a69ee0f/users/2776ae7603c741b7b5c8fc4bbe781310/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:20.036970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e5993-370f-4401-b999-793186dd20b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd5fe4fff384e1f907e3fc39a69ee0f, user_id=2776ae7603c741b7b5c8fc4bbe781310, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:20.039707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e5993-370f-4401-b999-793186dd20b3 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:20.139385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1092/2147] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:20 2022] PUT /identity/v3/projects/6dd5fe4fff384e1f907e3fc39a69ee0f/users/2776ae7603c741b7b5c8fc4bbe781310/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:20.151369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b306e2-5708-49fb-b1e8-9d7a8f11a244 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:20.151907 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b306e2-5708-49fb-b1e8-9d7a8f11a244 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:20.152379 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b306e2-5708-49fb-b1e8-9d7a8f11a244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:20.179655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-05b306e2-5708-49fb-b1e8-9d7a8f11a244 None None] MFA Rules not processed for user `2776ae7603c741b7b5c8fc4bbe781310`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:20.180997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-05b306e2-5708-49fb-b1e8-9d7a8f11a244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:20.248784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1056/2148] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:20.253311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e5993-370f-4401-b999-793186dd20b3 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:20.317843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e5993-370f-4401-b999-793186dd20b3 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:20.322720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec439e04-14b0-48d0-a13c-57518a4b758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:20.323421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439e04-14b0-48d0-a13c-57518a4b758f admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:20.323706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439e04-14b0-48d0-a13c-57518a4b758f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:20.323981 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec439e04-14b0-48d0-a13c-57518a4b758f admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:20.324685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec439e04-14b0-48d0-a13c-57518a4b758f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:20.326589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec439e04-14b0-48d0-a13c-57518a4b758f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:20.346928 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:20.425668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1093/2149] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:03:20 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:03:20.429866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b306e2-5708-49fb-b1e8-9d7a8f11a244 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:20.441718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b306e2-5708-49fb-b1e8-9d7a8f11a244 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:20.499781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61947fc-b2dc-4264-9a4d-1069ef1c4e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:20.500366 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61947fc-b2dc-4264-9a4d-1069ef1c4e46 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:20.500675 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61947fc-b2dc-4264-9a4d-1069ef1c4e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:20.500949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61947fc-b2dc-4264-9a4d-1069ef1c4e46 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:20.501623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61947fc-b2dc-4264-9a4d-1069ef1c4e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:20.503791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61947fc-b2dc-4264-9a4d-1069ef1c4e46 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:20.628089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1057/2150] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:03:20 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:20.632001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec439e04-14b0-48d0-a13c-57518a4b758f admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:20.642351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec439e04-14b0-48d0-a13c-57518a4b758f admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:20.647282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dabfcb-83ea-4cce-a284-2600d450d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:20.648030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dabfcb-83ea-4cce-a284-2600d450d716 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:20.648299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dabfcb-83ea-4cce-a284-2600d450d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:20.648570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dabfcb-83ea-4cce-a284-2600d450d716 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:20.649371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dabfcb-83ea-4cce-a284-2600d450d716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:20.651996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dabfcb-83ea-4cce-a284-2600d450d716 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:20.665055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1094/2151] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:20.670024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61947fc-b2dc-4264-9a4d-1069ef1c4e46 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:20.680680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61947fc-b2dc-4264-9a4d-1069ef1c4e46 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:20.685956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f637b12-46d6-4568-9f02-308aca62fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:20.686843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637b12-46d6-4568-9f02-308aca62fae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:20.687185 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637b12-46d6-4568-9f02-308aca62fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:20.687466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f637b12-46d6-4568-9f02-308aca62fae1 admin admin] PATH_INFO: `/v3/projects/70124097acbd48ea9a47386495627619/users/842828c8caa945cc9e3df0cfaf464bae/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:20.707443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f637b12-46d6-4568-9f02-308aca62fae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70124097acbd48ea9a47386495627619, user_id=842828c8caa945cc9e3df0cfaf464bae, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:20.710136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f637b12-46d6-4568-9f02-308aca62fae1 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:20.816317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1058/2152] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:20 2022] PUT /identity/v3/projects/70124097acbd48ea9a47386495627619/users/842828c8caa945cc9e3df0cfaf464bae/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:03:20.820329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dabfcb-83ea-4cce-a284-2600d450d716 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:20.831836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dabfcb-83ea-4cce-a284-2600d450d716 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:20.847160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:20.891943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc105d-6a07-4b86-bc42-4ed7beaf999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:20.892636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc105d-6a07-4b86-bc42-4ed7beaf999d admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:20.892919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc105d-6a07-4b86-bc42-4ed7beaf999d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:20.893197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc105d-6a07-4b86-bc42-4ed7beaf999d admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:20.893936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc105d-6a07-4b86-bc42-4ed7beaf999d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:20.895607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc105d-6a07-4b86-bc42-4ed7beaf999d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:20.909963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1095/2153] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:20.911379 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f637b12-46d6-4568-9f02-308aca62fae1 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:20.922193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f637b12-46d6-4568-9f02-308aca62fae1 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:20.927079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aafde4-a8be-4de4-8a71-614ba25bd4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:20.927967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aafde4-a8be-4de4-8a71-614ba25bd4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:20.928252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aafde4-a8be-4de4-8a71-614ba25bd4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:20.928527 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aafde4-a8be-4de4-8a71-614ba25bd4e0 admin admin] PATH_INFO: `/v3/projects/70124097acbd48ea9a47386495627619/users/842828c8caa945cc9e3df0cfaf464bae/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:20.930527 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aafde4-a8be-4de4-8a71-614ba25bd4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70124097acbd48ea9a47386495627619, user_id=842828c8caa945cc9e3df0cfaf464bae, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:20.933478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aafde4-a8be-4de4-8a71-614ba25bd4e0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:20.944782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1059/2154] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:20 2022] PUT /identity/v3/projects/70124097acbd48ea9a47386495627619/users/842828c8caa945cc9e3df0cfaf464bae/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:03:20.956379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d647b-3210-42d1-97ab-bb556ec62522 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:20.956740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d647b-3210-42d1-97ab-bb556ec62522 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:20.961031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d647b-3210-42d1-97ab-bb556ec62522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:20.989313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-921d647b-3210-42d1-97ab-bb556ec62522 None None] MFA Rules not processed for user `842828c8caa945cc9e3df0cfaf464bae`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:20.990519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-921d647b-3210-42d1-97ab-bb556ec62522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:21.066544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1096/2155] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:21.094600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aafde4-a8be-4de4-8a71-614ba25bd4e0 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:21.096305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-82aafde4-a8be-4de4-8a71-614ba25bd4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:21.159655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aafde4-a8be-4de4-8a71-614ba25bd4e0 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:21.163437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf05f3e-e919-4801-9039-c78f71666c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:21.164214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf05f3e-e919-4801-9039-c78f71666c6f service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:21.164499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf05f3e-e919-4801-9039-c78f71666c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:21.164773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf05f3e-e919-4801-9039-c78f71666c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:21.175496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf05f3e-e919-4801-9039-c78f71666c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:21.176952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf05f3e-e919-4801-9039-c78f71666c6f service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:21.186438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1060/2156] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:21.618311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:21.759357 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:22.343618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d647b-3210-42d1-97ab-bb556ec62522 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:22.410019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d647b-3210-42d1-97ab-bb556ec62522 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:22.414384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:22.415280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:22.415849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:22.416235 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] PATH_INFO: `/v3/users/2776ae7603c741b7b5c8fc4bbe781310` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:22.418289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2776ae7603c741b7b5c8fc4bbe781310)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:22.420290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:22.661065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2776ae7603c741b7b5c8fc4bbe781310'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:22.661723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2776ae7603c741b7b5c8fc4bbe781310'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:22.662532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2776ae7603c741b7b5c8fc4bbe781310'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:22.730218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2776ae7603c741b7b5c8fc4bbe781310'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:22.738739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2776ae7603c741b7b5c8fc4bbe781310'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:22.756735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1097/2157] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:22 2022] DELETE /identity/v3/users/2776ae7603c741b7b5c8fc4bbe781310 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:22.761148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063aecd5-1e03-454f-af5d-6e944cacfc44 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:22.761654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063aecd5-1e03-454f-af5d-6e944cacfc44 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:22.761809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063aecd5-1e03-454f-af5d-6e944cacfc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:22.780244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-063aecd5-1e03-454f-af5d-6e944cacfc44 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:22.781458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-063aecd5-1e03-454f-af5d-6e944cacfc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:22.847316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1061/2158] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:22.858049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:22.859654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:22.918757 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba103a-1958-4446-8ad4-6e4e91da5234 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:22.922428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338e40-c6ff-454a-90d8-317ba4dad500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:22.923102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338e40-c6ff-454a-90d8-317ba4dad500 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:22.923382 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338e40-c6ff-454a-90d8-317ba4dad500 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:22.923654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338e40-c6ff-454a-90d8-317ba4dad500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:22.929505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:22.933116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42338e40-c6ff-454a-90d8-317ba4dad500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:22.934862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42338e40-c6ff-454a-90d8-317ba4dad500 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:22.944161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1098/2159] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:23.387638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063aecd5-1e03-454f-af5d-6e944cacfc44 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:23.389273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-063aecd5-1e03-454f-af5d-6e944cacfc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:23.402032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063aecd5-1e03-454f-af5d-6e944cacfc44 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:23.407566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:23.408578 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:23.408993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:23.409368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] PATH_INFO: `/v3/projects/6dd5fe4fff384e1f907e3fc39a69ee0f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:23.411139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd5fe4fff384e1f907e3fc39a69ee0f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:23.413824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:23.546776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd5fe4fff384e1f907e3fc39a69ee0f', 'request_id': 'req-ac32c624-4dee-4335-9509-38dec6e0e4fd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:23.552370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd5fe4fff384e1f907e3fc39a69ee0f', 'request_id': 'req-ac32c624-4dee-4335-9509-38dec6e0e4fd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:23.559356 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd5fe4fff384e1f907e3fc39a69ee0f', 'request_id': 'req-ac32c624-4dee-4335-9509-38dec6e0e4fd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:23.628337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] The token cache is being invalidate because project 6dd5fe4fff384e1f907e3fc39a69ee0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:23.628613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:23.629258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:23.630854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1062/2160] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:23 2022] DELETE /identity/v3/projects/6dd5fe4fff384e1f907e3fc39a69ee0f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:23.634913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338e40-c6ff-454a-90d8-317ba4dad500 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:23.645465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338e40-c6ff-454a-90d8-317ba4dad500 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:23.704283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:23.705473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:23.705754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:23.706025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] PATH_INFO: `/v3/users/842828c8caa945cc9e3df0cfaf464bae` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:23.707266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] RBAC: Authorizing `identity:delete_user(user_id=842828c8caa945cc9e3df0cfaf464bae)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:23.709369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:23.893073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842828c8caa945cc9e3df0cfaf464bae'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:23.893798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842828c8caa945cc9e3df0cfaf464bae'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:23.894472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842828c8caa945cc9e3df0cfaf464bae'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:23.958055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842828c8caa945cc9e3df0cfaf464bae'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:23.966245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f28d32e-3f8e-454e-9527-7bceeeb7feca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842828c8caa945cc9e3df0cfaf464bae'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:23.984864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1099/2161] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:23 2022] DELETE /identity/v3/users/842828c8caa945cc9e3df0cfaf464bae => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:24.468695 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:24.470161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:24.483999 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32c624-4dee-4335-9509-38dec6e0e4fd admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:24.556928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:24.557895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:24.558221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:24.558513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] PATH_INFO: `/v3/projects/70124097acbd48ea9a47386495627619` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:24.582723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70124097acbd48ea9a47386495627619)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:24.582723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:24.585706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:24.716260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70124097acbd48ea9a47386495627619', 'request_id': 'req-414ec2ff-5e1e-4236-a1d2-caa886d5670d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:24.721625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70124097acbd48ea9a47386495627619', 'request_id': 'req-414ec2ff-5e1e-4236-a1d2-caa886d5670d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:24.728027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70124097acbd48ea9a47386495627619', 'request_id': 'req-414ec2ff-5e1e-4236-a1d2-caa886d5670d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:24.937854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] The token cache is being invalidate because project 70124097acbd48ea9a47386495627619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:24.938174 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:24.938805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-414ec2ff-5e1e-4236-a1d2-caa886d5670d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:24.940384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1063/2162] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:24 2022] DELETE /identity/v3/projects/70124097acbd48ea9a47386495627619 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:24.945179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b72ca-1f03-41d8-ba95-4b524a68cc16 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:24.952638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b72ca-1f03-41d8-ba95-4b524a68cc16 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:24.952638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b72ca-1f03-41d8-ba95-4b524a68cc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:24.967038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-977b72ca-1f03-41d8-ba95-4b524a68cc16 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:24.968242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-977b72ca-1f03-41d8-ba95-4b524a68cc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:25.027579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1100/2163] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:25.035379 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0e2b4-5ba1-43e9-9e92-4bfc9f4d9fe1 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:25.035672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0e2b4-5ba1-43e9-9e92-4bfc9f4d9fe1 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:25.035957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0e2b4-5ba1-43e9-9e92-4bfc9f4d9fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:25.055292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8ea0e2b4-5ba1-43e9-9e92-4bfc9f4d9fe1 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:25.056530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8ea0e2b4-5ba1-43e9-9e92-4bfc9f4d9fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:25.065106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1064/2164] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:25.069296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b72ca-1f03-41d8-ba95-4b524a68cc16 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:25.081049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b72ca-1f03-41d8-ba95-4b524a68cc16 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:25.085556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc2afd-a929-4fc1-b19a-043c798c68e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:25.086196 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc2afd-a929-4fc1-b19a-043c798c68e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:25.086477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc2afd-a929-4fc1-b19a-043c798c68e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:25.086750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc2afd-a929-4fc1-b19a-043c798c68e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:25.087507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc2afd-a929-4fc1-b19a-043c798c68e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:03:25.087810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc2afd-a929-4fc1-b19a-043c798c68e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:25.089469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc2afd-a929-4fc1-b19a-043c798c68e8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:25.097830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:25.101244 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1101/2165] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:03:25.105699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0e2b4-5ba1-43e9-9e92-4bfc9f4d9fe1 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:25.114982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0e2b4-5ba1-43e9-9e92-4bfc9f4d9fe1 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:25.119679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a8333-37ae-48da-9dac-11cf15986313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:25.120873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a8333-37ae-48da-9dac-11cf15986313 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:25.121154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a8333-37ae-48da-9dac-11cf15986313 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:25.121427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a8333-37ae-48da-9dac-11cf15986313 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:25.122330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a8333-37ae-48da-9dac-11cf15986313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:25.124264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a8333-37ae-48da-9dac-11cf15986313 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:25.254504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1065/2166] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:03:25 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:25.258517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc2afd-a929-4fc1-b19a-043c798c68e8 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:25.268866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc2afd-a929-4fc1-b19a-043c798c68e8 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:25.327095 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dafb1e-7d42-4996-a610-cfda6687d9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:25.327764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dafb1e-7d42-4996-a610-cfda6687d9bb admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:25.328043 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dafb1e-7d42-4996-a610-cfda6687d9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:25.328315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dafb1e-7d42-4996-a610-cfda6687d9bb admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:25.328986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dafb1e-7d42-4996-a610-cfda6687d9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:25.331297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dafb1e-7d42-4996-a610-cfda6687d9bb admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:25.440897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1102/2167] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:03:25 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:25.444959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a8333-37ae-48da-9dac-11cf15986313 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:25.455749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a8333-37ae-48da-9dac-11cf15986313 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:25.460452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d433a-8a07-422e-ad2e-dc3e1b597bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:25.461114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d433a-8a07-422e-ad2e-dc3e1b597bbe admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:25.461402 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d433a-8a07-422e-ad2e-dc3e1b597bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:25.461703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d433a-8a07-422e-ad2e-dc3e1b597bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:25.462523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d433a-8a07-422e-ad2e-dc3e1b597bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:25.464315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d433a-8a07-422e-ad2e-dc3e1b597bbe admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:25.482489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1066/2168] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:25.486495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dafb1e-7d42-4996-a610-cfda6687d9bb admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:25.497088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dafb1e-7d42-4996-a610-cfda6687d9bb admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:25.501813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37cdbc-bb1b-48e3-b60e-46e3e9309aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:25.502466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37cdbc-bb1b-48e3-b60e-46e3e9309aab admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:25.502753 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37cdbc-bb1b-48e3-b60e-46e3e9309aab admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:25.503065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37cdbc-bb1b-48e3-b60e-46e3e9309aab admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:25.503793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37cdbc-bb1b-48e3-b60e-46e3e9309aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:25.505444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37cdbc-bb1b-48e3-b60e-46e3e9309aab admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:25.515444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1103/2169] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:25.519477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d433a-8a07-422e-ad2e-dc3e1b597bbe admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:25.529829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d433a-8a07-422e-ad2e-dc3e1b597bbe admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:25.534419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af38fea-9632-45df-af8f-6671a7ced34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:25.535320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af38fea-9632-45df-af8f-6671a7ced34a admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:25.535603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af38fea-9632-45df-af8f-6671a7ced34a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:25.535876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af38fea-9632-45df-af8f-6671a7ced34a admin admin] PATH_INFO: `/v3/projects/bebf3ee5fde849c6a0c91af420c63939/users/9d07491cfa6447a1b8e2970a3dd22e2a/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:25.550641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af38fea-9632-45df-af8f-6671a7ced34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bebf3ee5fde849c6a0c91af420c63939, user_id=9d07491cfa6447a1b8e2970a3dd22e2a, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:25.553340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af38fea-9632-45df-af8f-6671a7ced34a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:25.656449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1067/2170] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:25 2022] PUT /identity/v3/projects/bebf3ee5fde849c6a0c91af420c63939/users/9d07491cfa6447a1b8e2970a3dd22e2a/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:25.667729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990eb9-59a2-4311-8ecd-358529ee8130 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:25.674100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990eb9-59a2-4311-8ecd-358529ee8130 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:25.674100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8990eb9-59a2-4311-8ecd-358529ee8130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:25.697073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f8990eb9-59a2-4311-8ecd-358529ee8130 None None] MFA Rules not processed for user `9d07491cfa6447a1b8e2970a3dd22e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:25.698948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f8990eb9-59a2-4311-8ecd-358529ee8130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:25.770930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1104/2171] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:03:25.781904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af38fea-9632-45df-af8f-6671a7ced34a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:25.783625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0af38fea-9632-45df-af8f-6671a7ced34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:25.844606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af38fea-9632-45df-af8f-6671a7ced34a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:25.848223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a285a53-3930-4d1e-b09c-42b670ebd016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:25.848861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a285a53-3930-4d1e-b09c-42b670ebd016 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:25.849140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a285a53-3930-4d1e-b09c-42b670ebd016 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:25.849412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a285a53-3930-4d1e-b09c-42b670ebd016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:25.859783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a285a53-3930-4d1e-b09c-42b670ebd016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:25.861216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a285a53-3930-4d1e-b09c-42b670ebd016 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:25.869820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1068/2172] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:35.767687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:35.865881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:46.541421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8990eb9-59a2-4311-8ecd-358529ee8130 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:46.542876 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f8990eb9-59a2-4311-8ecd-358529ee8130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:46.607037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8990eb9-59a2-4311-8ecd-358529ee8130 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:46.612080 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:46.612938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:46.613218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:46.613520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] PATH_INFO: `/v3/users/0c93496fa01c417298054595724bdaa3` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:46.614682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c93496fa01c417298054595724bdaa3)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:46.616648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:46.779449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c93496fa01c417298054595724bdaa3'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:46.780102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c93496fa01c417298054595724bdaa3'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:46.780721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c93496fa01c417298054595724bdaa3'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:46.856959 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c93496fa01c417298054595724bdaa3'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:46.864053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c93496fa01c417298054595724bdaa3'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:46.880700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1105/2173] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:03:46 2022] DELETE /identity/v3/users/0c93496fa01c417298054595724bdaa3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:46.885166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103829fb-9445-4d43-9a3b-179315297774 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:46.885645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103829fb-9445-4d43-9a3b-179315297774 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:46.885755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103829fb-9445-4d43-9a3b-179315297774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:46.902936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-103829fb-9445-4d43-9a3b-179315297774 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:46.904175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-103829fb-9445-4d43-9a3b-179315297774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:46.961998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1069/2174] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:46.972132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:46.973509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:47.028907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be389e3-5cb9-4747-9bbc-2d85c9185f78 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:47.033186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d480981-1fc4-45a3-87d5-86d5536b97e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:47.033819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480981-1fc4-45a3-87d5-86d5536b97e6 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:47.034100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480981-1fc4-45a3-87d5-86d5536b97e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:47.034373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d480981-1fc4-45a3-87d5-86d5536b97e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:47.047699 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d480981-1fc4-45a3-87d5-86d5536b97e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:47.049115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d480981-1fc4-45a3-87d5-86d5536b97e6 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:47.058600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1106/2175] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:03:47.496596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103829fb-9445-4d43-9a3b-179315297774 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:47.498095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-103829fb-9445-4d43-9a3b-179315297774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:47.511476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103829fb-9445-4d43-9a3b-179315297774 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:47.516866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:47.517740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:47.518023 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:47.518708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] PATH_INFO: `/v3/projects/b2c13a7cd85f420eb577b61fee914e4b` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:47.519534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c13a7cd85f420eb577b61fee914e4b)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:47.521526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:47.655371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c13a7cd85f420eb577b61fee914e4b', 'request_id': 'req-ead05297-0ea9-47bf-94bf-4c9552a40871'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:47.662158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c13a7cd85f420eb577b61fee914e4b', 'request_id': 'req-ead05297-0ea9-47bf-94bf-4c9552a40871'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:47.668415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c13a7cd85f420eb577b61fee914e4b', 'request_id': 'req-ead05297-0ea9-47bf-94bf-4c9552a40871'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:47.766293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] The token cache is being invalidate because project b2c13a7cd85f420eb577b61fee914e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:03:47.766523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:47.767186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ead05297-0ea9-47bf-94bf-4c9552a40871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:03:47.768756 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1070/2176] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:03:47 2022] DELETE /identity/v3/projects/b2c13a7cd85f420eb577b61fee914e4b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:47.773683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5cfd4-c70c-4771-b2d6-3fcc50572e62 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:47.774178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5cfd4-c70c-4771-b2d6-3fcc50572e62 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:47.774430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5cfd4-c70c-4771-b2d6-3fcc50572e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:47.792775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-96b5cfd4-c70c-4771-b2d6-3fcc50572e62 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:47.793953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-96b5cfd4-c70c-4771-b2d6-3fcc50572e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:47.810868 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:47.854528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1107/2177] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:47.863135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3433dc2-854c-4a62-9837-f4828af89735 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:47.866252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3433dc2-854c-4a62-9837-f4828af89735 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:47.866252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3433dc2-854c-4a62-9837-f4828af89735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:47.882748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-d3433dc2-854c-4a62-9837-f4828af89735 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:47.883998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d3433dc2-854c-4a62-9837-f4828af89735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:47.892879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1071/2178] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:47.896963 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5cfd4-c70c-4771-b2d6-3fcc50572e62 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:47.906846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5cfd4-c70c-4771-b2d6-3fcc50572e62 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:47.911513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f580c-7419-46da-9be4-51bc2d642c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:47.912160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f580c-7419-46da-9be4-51bc2d642c86 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:47.912444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f580c-7419-46da-9be4-51bc2d642c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:47.912741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f580c-7419-46da-9be4-51bc2d642c86 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:47.913461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f580c-7419-46da-9be4-51bc2d642c86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:03:47.913770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f580c-7419-46da-9be4-51bc2d642c86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:47.915397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f580c-7419-46da-9be4-51bc2d642c86 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:47.926853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1108/2179] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:03:47.931045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3433dc2-854c-4a62-9837-f4828af89735 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:47.940609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3433dc2-854c-4a62-9837-f4828af89735 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:47.945148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f744fc-d016-4213-ad8a-05f68f397c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:47.945788 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f744fc-d016-4213-ad8a-05f68f397c40 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:47.946067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f744fc-d016-4213-ad8a-05f68f397c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:47.946339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f744fc-d016-4213-ad8a-05f68f397c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:47.947088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f744fc-d016-4213-ad8a-05f68f397c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:47.948980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f744fc-d016-4213-ad8a-05f68f397c40 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:48.039094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1072/2180] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:03:47 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:48.043270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f580c-7419-46da-9be4-51bc2d642c86 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:48.053147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f580c-7419-46da-9be4-51bc2d642c86 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:48.111366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207409ee-0c64-44e9-953e-8cc7a577dba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:48.117777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207409ee-0c64-44e9-953e-8cc7a577dba5 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:48.117777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207409ee-0c64-44e9-953e-8cc7a577dba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:48.117777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207409ee-0c64-44e9-953e-8cc7a577dba5 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:48.117777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207409ee-0c64-44e9-953e-8cc7a577dba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:48.117777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207409ee-0c64-44e9-953e-8cc7a577dba5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:48.212259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1109/2181] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:03:48 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:03:48.216374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f744fc-d016-4213-ad8a-05f68f397c40 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:48.226885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f744fc-d016-4213-ad8a-05f68f397c40 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:48.231468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adb731-2100-4867-8e8a-f4e260296f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:48.232118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adb731-2100-4867-8e8a-f4e260296f76 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:48.232404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adb731-2100-4867-8e8a-f4e260296f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:48.232681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adb731-2100-4867-8e8a-f4e260296f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:48.233522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adb731-2100-4867-8e8a-f4e260296f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:48.235171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54adb731-2100-4867-8e8a-f4e260296f76 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:48.245766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1073/2182] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:48.249619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207409ee-0c64-44e9-953e-8cc7a577dba5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:48.261071 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207409ee-0c64-44e9-953e-8cc7a577dba5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:48.266678 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777bd28-d96b-4df5-af10-91fbbbaaa9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:48.267101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777bd28-d96b-4df5-af10-91fbbbaaa9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:48.267391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777bd28-d96b-4df5-af10-91fbbbaaa9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:48.267667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777bd28-d96b-4df5-af10-91fbbbaaa9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:48.268396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777bd28-d96b-4df5-af10-91fbbbaaa9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:48.269992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777bd28-d96b-4df5-af10-91fbbbaaa9d8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:48.285445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1110/2183] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:03:48.286560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adb731-2100-4867-8e8a-f4e260296f76 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:48.297840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adb731-2100-4867-8e8a-f4e260296f76 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:48.302714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66488f-7621-4f29-94f0-8ebd3761a35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:48.303725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66488f-7621-4f29-94f0-8ebd3761a35e admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:48.304076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66488f-7621-4f29-94f0-8ebd3761a35e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:48.304536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66488f-7621-4f29-94f0-8ebd3761a35e admin admin] PATH_INFO: `/v3/projects/b52576cdb81a4e0fa48bb0014d498f55/users/f996291731fd4736aef811de5c946799/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:48.322757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66488f-7621-4f29-94f0-8ebd3761a35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52576cdb81a4e0fa48bb0014d498f55, user_id=f996291731fd4736aef811de5c946799, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:48.325654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66488f-7621-4f29-94f0-8ebd3761a35e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:48.397285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1074/2184] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:03:48 2022] PUT /identity/v3/projects/b52576cdb81a4e0fa48bb0014d498f55/users/f996291731fd4736aef811de5c946799/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:03:48.407928 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebc94-7541-41af-8a66-e1286853253c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:48.408241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebc94-7541-41af-8a66-e1286853253c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:48.408517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acebc94-7541-41af-8a66-e1286853253c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:48.435575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7acebc94-7541-41af-8a66-e1286853253c None None] MFA Rules not processed for user `f996291731fd4736aef811de5c946799`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:03:48.436798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7acebc94-7541-41af-8a66-e1286853253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:48.502742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1111/2185] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:03:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:03:48.513445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66488f-7621-4f29-94f0-8ebd3761a35e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:03:48.515154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ae66488f-7621-4f29-94f0-8ebd3761a35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:03:48.538159 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:48.573019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66488f-7621-4f29-94f0-8ebd3761a35e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:03:48.576700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dcde2-2666-49f6-b4bb-571221495815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:03:48.577348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dcde2-2666-49f6-b4bb-571221495815 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:03:48.577629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dcde2-2666-49f6-b4bb-571221495815 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:03:48.577912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dcde2-2666-49f6-b4bb-571221495815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:03:48.588032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dcde2-2666-49f6-b4bb-571221495815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:03:48.589479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dcde2-2666-49f6-b4bb-571221495815 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:03:48.599670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1075/2186] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:03:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:03:58.498439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:03:58.994563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=17 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:02.633550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebc94-7541-41af-8a66-e1286853253c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:02.635686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7acebc94-7541-41af-8a66-e1286853253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:02.700989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acebc94-7541-41af-8a66-e1286853253c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:02.705721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:02.706584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:02.706868 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:02.707178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] PATH_INFO: `/v3/users/9d07491cfa6447a1b8e2970a3dd22e2a` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:02.708357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d07491cfa6447a1b8e2970a3dd22e2a)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:02.710317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:03.002728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d07491cfa6447a1b8e2970a3dd22e2a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:03.003408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d07491cfa6447a1b8e2970a3dd22e2a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:03.004057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d07491cfa6447a1b8e2970a3dd22e2a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:03.094567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d07491cfa6447a1b8e2970a3dd22e2a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:03.102426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d07491cfa6447a1b8e2970a3dd22e2a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:03.120866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1112/2187] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:04:02 2022] DELETE /identity/v3/users/9d07491cfa6447a1b8e2970a3dd22e2a => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:03.125316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935f17-6557-492d-a247-7461ade9713f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:03.125811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935f17-6557-492d-a247-7461ade9713f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:03.125928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7935f17-6557-492d-a247-7461ade9713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:03.143105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-c7935f17-6557-492d-a247-7461ade9713f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:03.144296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c7935f17-6557-492d-a247-7461ade9713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:03.203611 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1076/2188] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:03.213785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:03.215219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:03.275812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b20bd-06cb-49bf-9c2d-b749911f72a0 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:03.279356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5351f-a028-4e3d-8f8d-06174e9b41cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:03.279997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5351f-a028-4e3d-8f8d-06174e9b41cf service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:03.280277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5351f-a028-4e3d-8f8d-06174e9b41cf service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:03.280550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5351f-a028-4e3d-8f8d-06174e9b41cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:03.289532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5351f-a028-4e3d-8f8d-06174e9b41cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:03.291640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5351f-a028-4e3d-8f8d-06174e9b41cf service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:03.301086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1113/2189] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:03.787626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935f17-6557-492d-a247-7461ade9713f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:03.789848 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c7935f17-6557-492d-a247-7461ade9713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:03.804255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7935f17-6557-492d-a247-7461ade9713f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:03.809812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:03.810714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:03.811014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:03.811302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] PATH_INFO: `/v3/projects/bebf3ee5fde849c6a0c91af420c63939` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:03.812918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bebf3ee5fde849c6a0c91af420c63939)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:03.814926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:03.938833 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bebf3ee5fde849c6a0c91af420c63939', 'request_id': 'req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:03.944439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bebf3ee5fde849c6a0c91af420c63939', 'request_id': 'req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:03.951291 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bebf3ee5fde849c6a0c91af420c63939', 'request_id': 'req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:04.022179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] The token cache is being invalidate because project bebf3ee5fde849c6a0c91af420c63939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:04:04.022480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:04.023106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ed794d33-68aa-4dcc-a38a-d7b8bf7f8a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:04.024741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1077/2190] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:04:03 2022] DELETE /identity/v3/projects/bebf3ee5fde849c6a0c91af420c63939 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:04.030706 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa45ea-1135-4dc7-b687-39493eb80058 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.031328 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa45ea-1135-4dc7-b687-39493eb80058 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.031328 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa45ea-1135-4dc7-b687-39493eb80058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.048647 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-1caa45ea-1135-4dc7-b687-39493eb80058 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:04.049846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1caa45ea-1135-4dc7-b687-39493eb80058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:04.067497 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:04.110717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1114/2191] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:04:04.118468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56494345-e8e6-4ce6-b753-f639a544b8e5 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.118782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56494345-e8e6-4ce6-b753-f639a544b8e5 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.119096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56494345-e8e6-4ce6-b753-f639a544b8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.138453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-56494345-e8e6-4ce6-b753-f639a544b8e5 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:04.139842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-56494345-e8e6-4ce6-b753-f639a544b8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:04.148474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1078/2192] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:04.153426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa45ea-1135-4dc7-b687-39493eb80058 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:04.163230 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa45ea-1135-4dc7-b687-39493eb80058 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:04.168444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bb866-cd02-4e47-912d-0e1b9f89863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:04.169091 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bb866-cd02-4e47-912d-0e1b9f89863b admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.169374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bb866-cd02-4e47-912d-0e1b9f89863b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.169650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bb866-cd02-4e47-912d-0e1b9f89863b admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.170374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bb866-cd02-4e47-912d-0e1b9f89863b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:04:04.170680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bb866-cd02-4e47-912d-0e1b9f89863b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:04.172347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bb866-cd02-4e47-912d-0e1b9f89863b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:04.184689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1115/2193] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:04:04.188980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56494345-e8e6-4ce6-b753-f639a544b8e5 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:04.199261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56494345-e8e6-4ce6-b753-f639a544b8e5 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:04.204022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d7b8c-65ce-44ec-8a71-14f5d9735f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:04.204686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d7b8c-65ce-44ec-8a71-14f5d9735f04 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.204975 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d7b8c-65ce-44ec-8a71-14f5d9735f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.205523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d7b8c-65ce-44ec-8a71-14f5d9735f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.206230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d7b8c-65ce-44ec-8a71-14f5d9735f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:04.208445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d7b8c-65ce-44ec-8a71-14f5d9735f04 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:04.307376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1079/2194] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:04:04 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:04.311717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bb866-cd02-4e47-912d-0e1b9f89863b admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:04.322807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bb866-cd02-4e47-912d-0e1b9f89863b admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:04.380430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93640786-4f41-40cb-b4e9-f774ffcf8171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:04.381090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93640786-4f41-40cb-b4e9-f774ffcf8171 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.381370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93640786-4f41-40cb-b4e9-f774ffcf8171 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.381644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93640786-4f41-40cb-b4e9-f774ffcf8171 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.382319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93640786-4f41-40cb-b4e9-f774ffcf8171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:04.384251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93640786-4f41-40cb-b4e9-f774ffcf8171 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:04.474811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1116/2195] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:04:04 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:04.478940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d7b8c-65ce-44ec-8a71-14f5d9735f04 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:04.489359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d7b8c-65ce-44ec-8a71-14f5d9735f04 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:04.494415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5ef0f-4163-4ce6-b685-a2af8ef2a821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:04.495087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5ef0f-4163-4ce6-b685-a2af8ef2a821 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.495367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5ef0f-4163-4ce6-b685-a2af8ef2a821 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.495641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5ef0f-4163-4ce6-b685-a2af8ef2a821 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.496390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5ef0f-4163-4ce6-b685-a2af8ef2a821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:04.497979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5ef0f-4163-4ce6-b685-a2af8ef2a821 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:04.508696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1080/2196] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:04:04.513285 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93640786-4f41-40cb-b4e9-f774ffcf8171 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:04.523292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93640786-4f41-40cb-b4e9-f774ffcf8171 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:04.528120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232cca8-5ac9-49b2-9391-f05e855e10c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:04.528779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232cca8-5ac9-49b2-9391-f05e855e10c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.529063 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232cca8-5ac9-49b2-9391-f05e855e10c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.529338 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232cca8-5ac9-49b2-9391-f05e855e10c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.530066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232cca8-5ac9-49b2-9391-f05e855e10c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:04.531698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232cca8-5ac9-49b2-9391-f05e855e10c7 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:04.541805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1117/2197] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:04:04.547182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5ef0f-4163-4ce6-b685-a2af8ef2a821 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:04.558027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5ef0f-4163-4ce6-b685-a2af8ef2a821 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:04.562877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6d3d-f312-48a5-8d7a-60ee3f5182ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:04.563833 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6d3d-f312-48a5-8d7a-60ee3f5182ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.564110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6d3d-f312-48a5-8d7a-60ee3f5182ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.564381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6d3d-f312-48a5-8d7a-60ee3f5182ec admin admin] PATH_INFO: `/v3/projects/105f50511dc34ef898fcc00fb3db837f/users/604055ba289b4381bc1cc6b5d238999b/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.580997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6d3d-f312-48a5-8d7a-60ee3f5182ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=105f50511dc34ef898fcc00fb3db837f, user_id=604055ba289b4381bc1cc6b5d238999b, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:04.583683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6d3d-f312-48a5-8d7a-60ee3f5182ec admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:04.660747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1081/2198] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:04:04 2022] PUT /identity/v3/projects/105f50511dc34ef898fcc00fb3db837f/users/604055ba289b4381bc1cc6b5d238999b/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:04.666576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab51e64-4394-44aa-a800-d0d486771705 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.666953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab51e64-4394-44aa-a800-d0d486771705 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.667310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab51e64-4394-44aa-a800-d0d486771705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.686695 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0ab51e64-4394-44aa-a800-d0d486771705 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:04.687994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0ab51e64-4394-44aa-a800-d0d486771705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:04.752219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1118/2199] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:04.762091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6d3d-f312-48a5-8d7a-60ee3f5182ec admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:04.764017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f47d6d3d-f312-48a5-8d7a-60ee3f5182ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:04.793659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:04.824571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6d3d-f312-48a5-8d7a-60ee3f5182ec admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:04.828302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4c6f6-9872-4ded-a7ba-8dc97465e683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:04.828949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4c6f6-9872-4ded-a7ba-8dc97465e683 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.829235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4c6f6-9872-4ded-a7ba-8dc97465e683 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.829513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4c6f6-9872-4ded-a7ba-8dc97465e683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.839362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4c6f6-9872-4ded-a7ba-8dc97465e683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:04.840705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4c6f6-9872-4ded-a7ba-8dc97465e683 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:04.850226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1082/2200] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:04.878223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab51e64-4394-44aa-a800-d0d486771705 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:04.879720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0ab51e64-4394-44aa-a800-d0d486771705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:04.891517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab51e64-4394-44aa-a800-d0d486771705 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:04.896497 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:04.897412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:04.897695 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:04.897971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] PATH_INFO: `/v3/users/f996291731fd4736aef811de5c946799` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:04.899211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f996291731fd4736aef811de5c946799)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:04.901215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:04.924434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:05.153187 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f996291731fd4736aef811de5c946799'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:05.153793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f996291731fd4736aef811de5c946799'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:05.154353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f996291731fd4736aef811de5c946799'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:05.257528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f996291731fd4736aef811de5c946799'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:05.265476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f996291731fd4736aef811de5c946799'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:05.284084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1119/2201] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:04:04 2022] DELETE /identity/v3/users/f996291731fd4736aef811de5c946799 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:05.288520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48cb6a-3d1c-4789-af5c-57b0acf33852 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:05.291393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48cb6a-3d1c-4789-af5c-57b0acf33852 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:05.291393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48cb6a-3d1c-4789-af5c-57b0acf33852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:05.306798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ca48cb6a-3d1c-4789-af5c-57b0acf33852 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:05.308062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ca48cb6a-3d1c-4789-af5c-57b0acf33852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:05.374691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1083/2202] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:05.381993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:05.383549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:05.457176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281c350-f8e9-41c0-b124-aa88a14742a9 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:05.461264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d85ae-8b66-4d05-9f28-79491bef4b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:05.462140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d85ae-8b66-4d05-9f28-79491bef4b1a service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:05.462580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d85ae-8b66-4d05-9f28-79491bef4b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:05.463517 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d85ae-8b66-4d05-9f28-79491bef4b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:05.473620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d85ae-8b66-4d05-9f28-79491bef4b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:05.475263 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d85ae-8b66-4d05-9f28-79491bef4b1a service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:05.486301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1120/2203] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:06.316696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48cb6a-3d1c-4789-af5c-57b0acf33852 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:06.318264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ca48cb6a-3d1c-4789-af5c-57b0acf33852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:06.331554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48cb6a-3d1c-4789-af5c-57b0acf33852 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:06.337763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:06.338670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:06.339135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:06.339414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] PATH_INFO: `/v3/projects/b52576cdb81a4e0fa48bb0014d498f55` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:06.340627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52576cdb81a4e0fa48bb0014d498f55)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:06.342593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:06.453072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52576cdb81a4e0fa48bb0014d498f55', 'request_id': 'req-8c50945a-3e1f-4458-91ed-79ae2ccf1747'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:06.458822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52576cdb81a4e0fa48bb0014d498f55', 'request_id': 'req-8c50945a-3e1f-4458-91ed-79ae2ccf1747'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:06.466121 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52576cdb81a4e0fa48bb0014d498f55', 'request_id': 'req-8c50945a-3e1f-4458-91ed-79ae2ccf1747'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:06.577322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] The token cache is being invalidate because project b52576cdb81a4e0fa48bb0014d498f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:04:06.578204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:06.579224 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8c50945a-3e1f-4458-91ed-79ae2ccf1747 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:06.582307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1084/2204] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:04:06 2022] DELETE /identity/v3/projects/b52576cdb81a4e0fa48bb0014d498f55 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:06.589357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9647680-c48f-4783-bd16-0e1300d91ad2 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:06.590348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9647680-c48f-4783-bd16-0e1300d91ad2 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:06.590619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9647680-c48f-4783-bd16-0e1300d91ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:06.609866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-c9647680-c48f-4783-bd16-0e1300d91ad2 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:06.611104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c9647680-c48f-4783-bd16-0e1300d91ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:06.654157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17eda-34f5-4c0f-a2a4-ecd6a0fee0a6 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:06.654157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17eda-34f5-4c0f-a2a4-ecd6a0fee0a6 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:06.654157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17eda-34f5-4c0f-a2a4-ecd6a0fee0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:06.689884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-bef17eda-34f5-4c0f-a2a4-ecd6a0fee0a6 None None] MFA Rules not processed for user `604055ba289b4381bc1cc6b5d238999b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:06.691144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-bef17eda-34f5-4c0f-a2a4-ecd6a0fee0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:06.700308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1121/2205] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:06.707712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eaf6a-4c77-475a-aebb-9c144371957d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:06.707891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eaf6a-4c77-475a-aebb-9c144371957d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:06.708059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590eaf6a-4c77-475a-aebb-9c144371957d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:06.729004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-590eaf6a-4c77-475a-aebb-9c144371957d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:06.730834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-590eaf6a-4c77-475a-aebb-9c144371957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:06.736900 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:06.739958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1122/2206] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:06.744204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590eaf6a-4c77-475a-aebb-9c144371957d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:06.753556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590eaf6a-4c77-475a-aebb-9c144371957d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:06.758324 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f707401-1d2f-4cb5-b68d-1da05002bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:06.758927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707401-1d2f-4cb5-b68d-1da05002bbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:06.759235 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707401-1d2f-4cb5-b68d-1da05002bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:06.759566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707401-1d2f-4cb5-b68d-1da05002bbc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:06.760354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f707401-1d2f-4cb5-b68d-1da05002bbc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:04:06.760662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f707401-1d2f-4cb5-b68d-1da05002bbc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:06.762260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f707401-1d2f-4cb5-b68d-1da05002bbc7 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:06.779167 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1085/2208] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:06.780728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1123/2208] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:04:06.780850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17eda-34f5-4c0f-a2a4-ecd6a0fee0a6 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:06.788213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f707401-1d2f-4cb5-b68d-1da05002bbc7 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:06.789906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5f707401-1d2f-4cb5-b68d-1da05002bbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:06.797214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17eda-34f5-4c0f-a2a4-ecd6a0fee0a6 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:06.801958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810729b4-76a7-45a5-9b48-f632642ebe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:06.802623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810729b4-76a7-45a5-9b48-f632642ebe97 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:06.802895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810729b4-76a7-45a5-9b48-f632642ebe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:06.803199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810729b4-76a7-45a5-9b48-f632642ebe97 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:06.803898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810729b4-76a7-45a5-9b48-f632642ebe97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:06.805803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810729b4-76a7-45a5-9b48-f632642ebe97 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:06.821574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:06.851377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f707401-1d2f-4cb5-b68d-1da05002bbc7 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:06.855723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd5d35-f5a5-4dea-85da-87f5f8c96189 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:06.856373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5d35-f5a5-4dea-85da-87f5f8c96189 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:06.856650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5d35-f5a5-4dea-85da-87f5f8c96189 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:06.856926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5d35-f5a5-4dea-85da-87f5f8c96189 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:06.865149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd5d35-f5a5-4dea-85da-87f5f8c96189 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:06.866578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd5d35-f5a5-4dea-85da-87f5f8c96189 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:06.876119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1124/2209] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:04:06.890513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1086/2210] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:04:06 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:06.894689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd5d35-f5a5-4dea-85da-87f5f8c96189 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:06.909127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd5d35-f5a5-4dea-85da-87f5f8c96189 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:06.963624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e15d1-08ec-40a8-8458-591d374f9b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:06.964509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e15d1-08ec-40a8-8458-591d374f9b67 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:06.964791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e15d1-08ec-40a8-8458-591d374f9b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:06.965065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e15d1-08ec-40a8-8458-591d374f9b67 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:06.965754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e15d1-08ec-40a8-8458-591d374f9b67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:06.967756 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e15d1-08ec-40a8-8458-591d374f9b67 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:07.104245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1125/2211] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:04:06 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:07.105769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810729b4-76a7-45a5-9b48-f632642ebe97 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:07.116541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810729b4-76a7-45a5-9b48-f632642ebe97 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:07.122633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52b9fa-42cd-4ba8-82d7-873bc4fa6bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:07.123405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52b9fa-42cd-4ba8-82d7-873bc4fa6bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:07.123687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52b9fa-42cd-4ba8-82d7-873bc4fa6bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:07.124005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52b9fa-42cd-4ba8-82d7-873bc4fa6bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:07.124738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52b9fa-42cd-4ba8-82d7-873bc4fa6bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:07.126498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52b9fa-42cd-4ba8-82d7-873bc4fa6bd7 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:07.146937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1087/2212] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:04:07.149338 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e15d1-08ec-40a8-8458-591d374f9b67 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:07.159663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e15d1-08ec-40a8-8458-591d374f9b67 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:07.164735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52afff-7034-4a74-b870-35d0159992ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:07.165254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52afff-7034-4a74-b870-35d0159992ce admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:07.166029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52afff-7034-4a74-b870-35d0159992ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:07.166481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52afff-7034-4a74-b870-35d0159992ce admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:07.167252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52afff-7034-4a74-b870-35d0159992ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:07.168861 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52afff-7034-4a74-b870-35d0159992ce admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:07.183019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1126/2213] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:04:07.184424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52b9fa-42cd-4ba8-82d7-873bc4fa6bd7 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:07.194839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52b9fa-42cd-4ba8-82d7-873bc4fa6bd7 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:07.199657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383a68a-f60f-40d5-bae5-19f22fe728be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:07.200641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383a68a-f60f-40d5-bae5-19f22fe728be admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:07.200988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383a68a-f60f-40d5-bae5-19f22fe728be admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:07.201268 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383a68a-f60f-40d5-bae5-19f22fe728be admin admin] PATH_INFO: `/v3/projects/3dd1568df92d474eb37a8492e53766f5/users/11d3cab03bce4f0cb3e705e0306655f5/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:07.218371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383a68a-f60f-40d5-bae5-19f22fe728be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd1568df92d474eb37a8492e53766f5, user_id=11d3cab03bce4f0cb3e705e0306655f5, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:07.221415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383a68a-f60f-40d5-bae5-19f22fe728be admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:07.397497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1088/2214] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:04:07 2022] PUT /identity/v3/projects/3dd1568df92d474eb37a8492e53766f5/users/11d3cab03bce4f0cb3e705e0306655f5/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:07.409198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706264b1-4078-41d9-baba-cb1cef2a29f6 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:07.409512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706264b1-4078-41d9-baba-cb1cef2a29f6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:07.409761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706264b1-4078-41d9-baba-cb1cef2a29f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:07.438330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-706264b1-4078-41d9-baba-cb1cef2a29f6 None None] MFA Rules not processed for user `11d3cab03bce4f0cb3e705e0306655f5`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:07.439590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-706264b1-4078-41d9-baba-cb1cef2a29f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:07.503350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1127/2215] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:07.507903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383a68a-f60f-40d5-bae5-19f22fe728be admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:07.569635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383a68a-f60f-40d5-bae5-19f22fe728be admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:07.574358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a29c5-a6e0-42a5-a214-6b8b1a6ea12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:07.575037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a29c5-a6e0-42a5-a214-6b8b1a6ea12e admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:07.575319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a29c5-a6e0-42a5-a214-6b8b1a6ea12e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:07.575594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a29c5-a6e0-42a5-a214-6b8b1a6ea12e admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:07.576286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a29c5-a6e0-42a5-a214-6b8b1a6ea12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:07.578184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a29c5-a6e0-42a5-a214-6b8b1a6ea12e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:07.693242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1089/2216] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:04:07 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:07.697891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706264b1-4078-41d9-baba-cb1cef2a29f6 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:07.708905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706264b1-4078-41d9-baba-cb1cef2a29f6 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:07.741849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:07.767168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d84be-d9ec-4a55-9c2e-ea6e9b46eb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:07.767840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d84be-d9ec-4a55-9c2e-ea6e9b46eb3f admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:07.768122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d84be-d9ec-4a55-9c2e-ea6e9b46eb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:07.768397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d84be-d9ec-4a55-9c2e-ea6e9b46eb3f admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:07.769096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d84be-d9ec-4a55-9c2e-ea6e9b46eb3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:07.771058 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d84be-d9ec-4a55-9c2e-ea6e9b46eb3f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:07.872142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1128/2217] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:04:07 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:07.876019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a29c5-a6e0-42a5-a214-6b8b1a6ea12e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:07.887242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a29c5-a6e0-42a5-a214-6b8b1a6ea12e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:07.891886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc3e7d-ab86-4a3b-9619-2764a01737dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:07.892542 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc3e7d-ab86-4a3b-9619-2764a01737dc admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:07.892825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc3e7d-ab86-4a3b-9619-2764a01737dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:07.893095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc3e7d-ab86-4a3b-9619-2764a01737dc admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:07.893819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc3e7d-ab86-4a3b-9619-2764a01737dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:07.895559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc3e7d-ab86-4a3b-9619-2764a01737dc admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:07.907329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1090/2218] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:04:07.911236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d84be-d9ec-4a55-9c2e-ea6e9b46eb3f admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:07.921236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d84be-d9ec-4a55-9c2e-ea6e9b46eb3f admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:07.925969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ff3dc-e469-4901-80e3-6b448f321b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:07.926618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ff3dc-e469-4901-80e3-6b448f321b4e admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:07.926901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ff3dc-e469-4901-80e3-6b448f321b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:07.927236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ff3dc-e469-4901-80e3-6b448f321b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:07.927942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ff3dc-e469-4901-80e3-6b448f321b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:07.929545 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ff3dc-e469-4901-80e3-6b448f321b4e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:07.939462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1129/2219] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:04:07.943548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc3e7d-ab86-4a3b-9619-2764a01737dc admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:07.954223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc3e7d-ab86-4a3b-9619-2764a01737dc admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:07.959207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b96e8-d2d4-453f-938c-21b94d10175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:07.960101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b96e8-d2d4-453f-938c-21b94d10175a admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:07.960384 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b96e8-d2d4-453f-938c-21b94d10175a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:07.960660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b96e8-d2d4-453f-938c-21b94d10175a admin admin] PATH_INFO: `/v3/projects/dbd70f2f092d4eed9662c34271b7f3c6/users/2fdb29dded1443b486f67bd289efedc0/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:07.976334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b96e8-d2d4-453f-938c-21b94d10175a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd70f2f092d4eed9662c34271b7f3c6, user_id=2fdb29dded1443b486f67bd289efedc0, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:07.979342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b96e8-d2d4-453f-938c-21b94d10175a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:08.071125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1091/2220] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:04:07 2022] PUT /identity/v3/projects/dbd70f2f092d4eed9662c34271b7f3c6/users/2fdb29dded1443b486f67bd289efedc0/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:08.082274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18564ffa-70d8-45be-a1ec-ffabf757a925 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:08.082566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18564ffa-70d8-45be-a1ec-ffabf757a925 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:08.082840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18564ffa-70d8-45be-a1ec-ffabf757a925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:08.110581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-18564ffa-70d8-45be-a1ec-ffabf757a925 None None] MFA Rules not processed for user `2fdb29dded1443b486f67bd289efedc0`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:08.111832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-18564ffa-70d8-45be-a1ec-ffabf757a925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:08.174743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1130/2221] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:08.179207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b96e8-d2d4-453f-938c-21b94d10175a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:08.212266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:08.242564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b96e8-d2d4-453f-938c-21b94d10175a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:08.247277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4601eb-05a1-4f4d-b822-d1f71e8cdc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:08.259808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4601eb-05a1-4f4d-b822-d1f71e8cdc2e admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:08.259808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4601eb-05a1-4f4d-b822-d1f71e8cdc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:08.259808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4601eb-05a1-4f4d-b822-d1f71e8cdc2e admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:08.259808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4601eb-05a1-4f4d-b822-d1f71e8cdc2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:08.259808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4601eb-05a1-4f4d-b822-d1f71e8cdc2e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:08.451014 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1092/2222] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:04:08 2022] POST /identity/v3/projects => generated 375 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:08.456054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18564ffa-70d8-45be-a1ec-ffabf757a925 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:08.467540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18564ffa-70d8-45be-a1ec-ffabf757a925 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:08.523629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a49b-44c9-468f-ade5-f0cc7b6148a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:08.524319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a49b-44c9-468f-ade5-f0cc7b6148a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:08.524603 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a49b-44c9-468f-ade5-f0cc7b6148a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:08.524954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435a49b-44c9-468f-ade5-f0cc7b6148a1 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:08.526477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a49b-44c9-468f-ade5-f0cc7b6148a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:08.528450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435a49b-44c9-468f-ade5-f0cc7b6148a1 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:08.623231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1131/2223] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:04:08 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:08.627311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4601eb-05a1-4f4d-b822-d1f71e8cdc2e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:08.638349 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4601eb-05a1-4f4d-b822-d1f71e8cdc2e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:08.643016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800bc44-20e0-4846-851a-23e9530921e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:08.643680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800bc44-20e0-4846-851a-23e9530921e6 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:08.643989 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800bc44-20e0-4846-851a-23e9530921e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:08.644381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800bc44-20e0-4846-851a-23e9530921e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:08.645114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800bc44-20e0-4846-851a-23e9530921e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:08.646721 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800bc44-20e0-4846-851a-23e9530921e6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:08.659558 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1093/2224] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:04:08.669927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a49b-44c9-468f-ade5-f0cc7b6148a1 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:08.680712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435a49b-44c9-468f-ade5-f0cc7b6148a1 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:08.686303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994d94-dfe5-4a42-9378-ea581cb67203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:08.687157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994d94-dfe5-4a42-9378-ea581cb67203 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:08.687442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994d94-dfe5-4a42-9378-ea581cb67203 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:08.687717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994d94-dfe5-4a42-9378-ea581cb67203 admin admin] PATH_INFO: `/v3/projects/473387dec90c4e07a44e8d1b6a0444fe/users/935bd381ff9647e493c68690c0409480/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:08.707882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28994d94-dfe5-4a42-9378-ea581cb67203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473387dec90c4e07a44e8d1b6a0444fe, user_id=935bd381ff9647e493c68690c0409480, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:08.711058 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28994d94-dfe5-4a42-9378-ea581cb67203 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:08.820600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1132/2225] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:04:08 2022] PUT /identity/v3/projects/473387dec90c4e07a44e8d1b6a0444fe/users/935bd381ff9647e493c68690c0409480/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:08.825668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800bc44-20e0-4846-851a-23e9530921e6 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:08.835861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800bc44-20e0-4846-851a-23e9530921e6 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:08.891575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3622a0-c2af-47b1-b035-54f38927eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:08.892241 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3622a0-c2af-47b1-b035-54f38927eda4 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:08.892525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3622a0-c2af-47b1-b035-54f38927eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:08.892802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3622a0-c2af-47b1-b035-54f38927eda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:08.893522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3622a0-c2af-47b1-b035-54f38927eda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:08.895177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3622a0-c2af-47b1-b035-54f38927eda4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:08.904763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1094/2226] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:04:08.908969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994d94-dfe5-4a42-9378-ea581cb67203 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:08.919268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994d94-dfe5-4a42-9378-ea581cb67203 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:08.923887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678919d9-eccc-4fee-871f-ef60eac0173a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:08.924790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678919d9-eccc-4fee-871f-ef60eac0173a admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:08.925075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678919d9-eccc-4fee-871f-ef60eac0173a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:08.925350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678919d9-eccc-4fee-871f-ef60eac0173a admin admin] PATH_INFO: `/v3/projects/473387dec90c4e07a44e8d1b6a0444fe/users/935bd381ff9647e493c68690c0409480/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:08.927356 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678919d9-eccc-4fee-871f-ef60eac0173a admin admin] RBAC: Authorizing `identity:create_grant(project_id=473387dec90c4e07a44e8d1b6a0444fe, user_id=935bd381ff9647e493c68690c0409480, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:08.930025 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678919d9-eccc-4fee-871f-ef60eac0173a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:08.933625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:08.940971 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1133/2227] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:04:08 2022] PUT /identity/v3/projects/473387dec90c4e07a44e8d1b6a0444fe/users/935bd381ff9647e493c68690c0409480/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:08.965954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811a45-a8f6-4f5a-bfdc-cf4cc36a278a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:08.966243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811a45-a8f6-4f5a-bfdc-cf4cc36a278a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:08.966520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811a45-a8f6-4f5a-bfdc-cf4cc36a278a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:08.992202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-44811a45-a8f6-4f5a-bfdc-cf4cc36a278a None None] MFA Rules not processed for user `935bd381ff9647e493c68690c0409480`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:08.993402 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-44811a45-a8f6-4f5a-bfdc-cf4cc36a278a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:09.063670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1095/2228] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:04:09.075816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678919d9-eccc-4fee-871f-ef60eac0173a admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:09.077883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-678919d9-eccc-4fee-871f-ef60eac0173a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:09.139332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678919d9-eccc-4fee-871f-ef60eac0173a admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:09.143463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3996cf0-dae7-4a8c-b0a9-04249f3d3a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:09.144169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3996cf0-dae7-4a8c-b0a9-04249f3d3a17 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:09.144459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3996cf0-dae7-4a8c-b0a9-04249f3d3a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:09.144737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3996cf0-dae7-4a8c-b0a9-04249f3d3a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:09.202254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3996cf0-dae7-4a8c-b0a9-04249f3d3a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:09.203665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3996cf0-dae7-4a8c-b0a9-04249f3d3a17 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:09.213405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1134/2229] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:09.764506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6845e1-e035-47d6-8f9e-c01d677c02b8 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:09.765106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6845e1-e035-47d6-8f9e-c01d677c02b8 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:09.765106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6845e1-e035-47d6-8f9e-c01d677c02b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:09.783325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8b6845e1-e035-47d6-8f9e-c01d677c02b8 None None] MFA Rules not processed for user `604055ba289b4381bc1cc6b5d238999b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:09.784505 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8b6845e1-e035-47d6-8f9e-c01d677c02b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:09.802596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:09.839216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1096/2230] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:12.058131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3996cf0-dae7-4a8c-b0a9-04249f3d3a17 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:12.059623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d3996cf0-dae7-4a8c-b0a9-04249f3d3a17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:12.139205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3996cf0-dae7-4a8c-b0a9-04249f3d3a17 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:12.144539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746f52-2d31-4fc4-97c3-60eab22f4ed9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:12.145204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746f52-2d31-4fc4-97c3-60eab22f4ed9 service placement] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:12.145491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746f52-2d31-4fc4-97c3-60eab22f4ed9 service placement] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:12.145794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9746f52-2d31-4fc4-97c3-60eab22f4ed9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:12.147774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c9746f52-2d31-4fc4-97c3-60eab22f4ed9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:12.161395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9746f52-2d31-4fc4-97c3-60eab22f4ed9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:12.163081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9746f52-2d31-4fc4-97c3-60eab22f4ed9 service placement] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:12.174017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1135/2231] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:12.556596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6845e1-e035-47d6-8f9e-c01d677c02b8 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:12.566421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6845e1-e035-47d6-8f9e-c01d677c02b8 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:12.570073 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60236ab4-cd8d-441d-a15d-debe57931943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:12.570746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60236ab4-cd8d-441d-a15d-debe57931943 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:12.571060 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60236ab4-cd8d-441d-a15d-debe57931943 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:12.571340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60236ab4-cd8d-441d-a15d-debe57931943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:12.629997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60236ab4-cd8d-441d-a15d-debe57931943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:12.631504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60236ab4-cd8d-441d-a15d-debe57931943 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:12.641196 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1097/2232] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:14.328978 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746f52-2d31-4fc4-97c3-60eab22f4ed9 service placement] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:14.339818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9746f52-2d31-4fc4-97c3-60eab22f4ed9 service placement] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:14.344002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced57cec-53e6-412d-9969-d7d73076b710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:14.344719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced57cec-53e6-412d-9969-d7d73076b710 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:14.345002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced57cec-53e6-412d-9969-d7d73076b710 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:14.345275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced57cec-53e6-412d-9969-d7d73076b710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:14.366743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced57cec-53e6-412d-9969-d7d73076b710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:14.366743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced57cec-53e6-412d-9969-d7d73076b710 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:14.374485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1136/2233] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:20.572714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60236ab4-cd8d-441d-a15d-debe57931943 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:20.640776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60236ab4-cd8d-441d-a15d-debe57931943 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:20.645621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:20.646590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:20.646890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:20.647241 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] PATH_INFO: `/v3/users/11d3cab03bce4f0cb3e705e0306655f5` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:20.648898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d3cab03bce4f0cb3e705e0306655f5)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:20.652723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:20.862005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d3cab03bce4f0cb3e705e0306655f5'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:20.862665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d3cab03bce4f0cb3e705e0306655f5'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:20.863304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d3cab03bce4f0cb3e705e0306655f5'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:20.870941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d3cab03bce4f0cb3e705e0306655f5'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:20.881842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:20.884239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d3cab03bce4f0cb3e705e0306655f5'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:20.956949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1098/2234] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:04:20 2022] DELETE /identity/v3/users/11d3cab03bce4f0cb3e705e0306655f5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:20.961560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2110b34-612c-4a50-a536-d12dbb5cdb28 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:20.962046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2110b34-612c-4a50-a536-d12dbb5cdb28 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:20.962182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2110b34-612c-4a50-a536-d12dbb5cdb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:20.979750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f2110b34-612c-4a50-a536-d12dbb5cdb28 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:20.981137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f2110b34-612c-4a50-a536-d12dbb5cdb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:21.005070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:21.059873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1137/2235] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:21.069470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:21.070996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:21.135266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dc286-18cd-4a69-93aa-ddd2cb9da626 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:21.138944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed29de-d28c-4d64-b6be-55d968d0adbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:21.139614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed29de-d28c-4d64-b6be-55d968d0adbc service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:21.139894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed29de-d28c-4d64-b6be-55d968d0adbc service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:21.140169 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed29de-d28c-4d64-b6be-55d968d0adbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:21.149102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed29de-d28c-4d64-b6be-55d968d0adbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:21.150568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed29de-d28c-4d64-b6be-55d968d0adbc service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:21.159971 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1099/2236] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:21.832651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2110b34-612c-4a50-a536-d12dbb5cdb28 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:21.835461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f2110b34-612c-4a50-a536-d12dbb5cdb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:21.846994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2110b34-612c-4a50-a536-d12dbb5cdb28 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:21.856214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:21.862315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:21.862615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:21.863018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] PATH_INFO: `/v3/projects/3dd1568df92d474eb37a8492e53766f5` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:21.864282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd1568df92d474eb37a8492e53766f5)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:21.866159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:21.974716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd1568df92d474eb37a8492e53766f5', 'request_id': 'req-8076066f-da5d-4012-adc1-e83a1b684f7e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:21.981470 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd1568df92d474eb37a8492e53766f5', 'request_id': 'req-8076066f-da5d-4012-adc1-e83a1b684f7e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:21.987780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd1568df92d474eb37a8492e53766f5', 'request_id': 'req-8076066f-da5d-4012-adc1-e83a1b684f7e'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:22.076039 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] The token cache is being invalidate because project 3dd1568df92d474eb37a8492e53766f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:04:22.076512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:22.077106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:22.078652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1138/2237] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:04:21 2022] DELETE /identity/v3/projects/3dd1568df92d474eb37a8492e53766f5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:22.083061 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed29de-d28c-4d64-b6be-55d968d0adbc service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:22.092736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed29de-d28c-4d64-b6be-55d968d0adbc service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:22.152618 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:22.153572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:22.153927 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:22.154211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] PATH_INFO: `/v3/users/2fdb29dded1443b486f67bd289efedc0` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:22.155745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fdb29dded1443b486f67bd289efedc0)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:22.157680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:22.400124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fdb29dded1443b486f67bd289efedc0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:22.400793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fdb29dded1443b486f67bd289efedc0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:22.401510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fdb29dded1443b486f67bd289efedc0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:22.408605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fdb29dded1443b486f67bd289efedc0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:22.422320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fdb29dded1443b486f67bd289efedc0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:22.526920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1100/2238] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:04:22 2022] DELETE /identity/v3/users/2fdb29dded1443b486f67bd289efedc0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:22.959199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:22.960731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:22.976021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076066f-da5d-4012-adc1-e83a1b684f7e admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:23.033726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:23.034579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:23.034882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:23.035215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] PATH_INFO: `/v3/projects/dbd70f2f092d4eed9662c34271b7f3c6` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:23.036455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd70f2f092d4eed9662c34271b7f3c6)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:23.038382 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:23.154110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd70f2f092d4eed9662c34271b7f3c6', 'request_id': 'req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:23.155967 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:23.159970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd70f2f092d4eed9662c34271b7f3c6', 'request_id': 'req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:23.166820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd70f2f092d4eed9662c34271b7f3c6', 'request_id': 'req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:23.265635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] The token cache is being invalidate because project dbd70f2f092d4eed9662c34271b7f3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:04:23.265921 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:23.266550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:23.268180 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1139/2239] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:04:22 2022] DELETE /identity/v3/projects/dbd70f2f092d4eed9662c34271b7f3c6 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:23.272197 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:23.273657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:23.286404 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2e712-a5a3-4e40-81a2-884f2607c72b admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:23.291096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:23.347680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:23.348567 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:23.348850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:23.349130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] PATH_INFO: `/v3/users/935bd381ff9647e493c68690c0409480` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:23.350488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] RBAC: Authorizing `identity:delete_user(user_id=935bd381ff9647e493c68690c0409480)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:23.352464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:23.512761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935bd381ff9647e493c68690c0409480'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:23.513437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935bd381ff9647e493c68690c0409480'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:23.514056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935bd381ff9647e493c68690c0409480'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:23.521242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935bd381ff9647e493c68690c0409480'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:23.533874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8ae17037-5a1e-4820-842b-58e21e27568b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935bd381ff9647e493c68690c0409480'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:23.595932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1101/2240] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:04:23 2022] DELETE /identity/v3/users/935bd381ff9647e493c68690c0409480 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:24.061120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:24.062513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:24.076358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e352-dad1-4b93-aeaf-10c6c004d9ca admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:24.134749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:24.135638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:24.135983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:24.136360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] PATH_INFO: `/v3/projects/473387dec90c4e07a44e8d1b6a0444fe` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:24.137553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] RBAC: Authorizing `identity:delete_project(project_id=473387dec90c4e07a44e8d1b6a0444fe)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:24.139576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:24.286651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473387dec90c4e07a44e8d1b6a0444fe', 'request_id': 'req-fab3e27b-02fe-4b8a-be37-73be6bfa193c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:24.292140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473387dec90c4e07a44e8d1b6a0444fe', 'request_id': 'req-fab3e27b-02fe-4b8a-be37-73be6bfa193c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:24.298280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473387dec90c4e07a44e8d1b6a0444fe', 'request_id': 'req-fab3e27b-02fe-4b8a-be37-73be6bfa193c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:24.450210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] The token cache is being invalidate because project 473387dec90c4e07a44e8d1b6a0444fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:04:24.450555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:24.451258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fab3e27b-02fe-4b8a-be37-73be6bfa193c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:24.456925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1140/2241] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:04:24 2022] DELETE /identity/v3/projects/473387dec90c4e07a44e8d1b6a0444fe => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:24.458605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0bc8b-00e7-4c67-8129-13efcafd16f9 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:24.459147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0bc8b-00e7-4c67-8129-13efcafd16f9 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:24.459402 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0bc8b-00e7-4c67-8129-13efcafd16f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:24.481560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-63f0bc8b-00e7-4c67-8129-13efcafd16f9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:24.483908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-63f0bc8b-00e7-4c67-8129-13efcafd16f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:24.579598 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1102/2242] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:24.588055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3e4db-fdd9-4412-85d2-6df248d5794e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:24.588377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3e4db-fdd9-4412-85d2-6df248d5794e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:24.588664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3e4db-fdd9-4412-85d2-6df248d5794e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:24.608349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-5db3e4db-fdd9-4412-85d2-6df248d5794e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:24.609837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5db3e4db-fdd9-4412-85d2-6df248d5794e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:24.620137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1141/2243] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:24.624069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0bc8b-00e7-4c67-8129-13efcafd16f9 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:24.634095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0bc8b-00e7-4c67-8129-13efcafd16f9 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:24.639643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948aa903-4a64-44c6-a53e-213625e615e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:24.640350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aa903-4a64-44c6-a53e-213625e615e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:24.640638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aa903-4a64-44c6-a53e-213625e615e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:24.641265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aa903-4a64-44c6-a53e-213625e615e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:24.642018 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948aa903-4a64-44c6-a53e-213625e615e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:04:24.642327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948aa903-4a64-44c6-a53e-213625e615e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:24.644016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948aa903-4a64-44c6-a53e-213625e615e8 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:24.658053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1103/2244] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:04:24.662415 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3e4db-fdd9-4412-85d2-6df248d5794e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:24.672619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3e4db-fdd9-4412-85d2-6df248d5794e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:24.677775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28400f8-9463-4a46-9094-d8e5d60403bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:24.678434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28400f8-9463-4a46-9094-d8e5d60403bc admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:24.678719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28400f8-9463-4a46-9094-d8e5d60403bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:24.679083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28400f8-9463-4a46-9094-d8e5d60403bc admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:24.679792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28400f8-9463-4a46-9094-d8e5d60403bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:24.682516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28400f8-9463-4a46-9094-d8e5d60403bc admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:24.822357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1142/2245] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:04:24 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:04:24.826665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948aa903-4a64-44c6-a53e-213625e615e8 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:24.836938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948aa903-4a64-44c6-a53e-213625e615e8 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:24.848447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:24.893892 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17905fa0-3f90-42dd-9bb2-445d898c7ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:24.894638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17905fa0-3f90-42dd-9bb2-445d898c7ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:24.894917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17905fa0-3f90-42dd-9bb2-445d898c7ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:24.895228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17905fa0-3f90-42dd-9bb2-445d898c7ab8 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:24.895923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17905fa0-3f90-42dd-9bb2-445d898c7ab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:24.897839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17905fa0-3f90-42dd-9bb2-445d898c7ab8 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:25.018510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1104/2246] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:04:24 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:25.022589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28400f8-9463-4a46-9094-d8e5d60403bc admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:25.033790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28400f8-9463-4a46-9094-d8e5d60403bc admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:25.039251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ff26-1aea-46bf-a54c-4c3864d3eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:25.040001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ff26-1aea-46bf-a54c-4c3864d3eca6 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:25.040267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ff26-1aea-46bf-a54c-4c3864d3eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:25.040677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ff26-1aea-46bf-a54c-4c3864d3eca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:25.041398 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3ff26-1aea-46bf-a54c-4c3864d3eca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:25.044259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3ff26-1aea-46bf-a54c-4c3864d3eca6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:25.055578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1143/2247] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:04:25.060337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17905fa0-3f90-42dd-9bb2-445d898c7ab8 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:25.078912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17905fa0-3f90-42dd-9bb2-445d898c7ab8 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:25.084934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350041f-e915-4476-99ae-a3c13f3f0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:25.085635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350041f-e915-4476-99ae-a3c13f3f0ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:25.085938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350041f-e915-4476-99ae-a3c13f3f0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:25.086237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350041f-e915-4476-99ae-a3c13f3f0ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:25.086962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350041f-e915-4476-99ae-a3c13f3f0ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:25.091371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350041f-e915-4476-99ae-a3c13f3f0ba6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:25.102340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1105/2248] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:04:25.105960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ff26-1aea-46bf-a54c-4c3864d3eca6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:25.115886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ff26-1aea-46bf-a54c-4c3864d3eca6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:25.121367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec196d-6972-4068-8973-a764bdeb4b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:25.122288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec196d-6972-4068-8973-a764bdeb4b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:25.122555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec196d-6972-4068-8973-a764bdeb4b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:25.122922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec196d-6972-4068-8973-a764bdeb4b59 admin admin] PATH_INFO: `/v3/projects/c518f7a073eb4335b403743a602c60ad/users/a89eb76296d04adf8cc9b24ef0165ec8/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:25.139584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec196d-6972-4068-8973-a764bdeb4b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c518f7a073eb4335b403743a602c60ad, user_id=a89eb76296d04adf8cc9b24ef0165ec8, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:25.142246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec196d-6972-4068-8973-a764bdeb4b59 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:25.220326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1144/2249] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:04:25 2022] PUT /identity/v3/projects/c518f7a073eb4335b403743a602c60ad/users/a89eb76296d04adf8cc9b24ef0165ec8/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:25.230779 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2ced4-08f6-465a-932f-4bf4311830b2 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:25.231109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2ced4-08f6-465a-932f-4bf4311830b2 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:25.231392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2ced4-08f6-465a-932f-4bf4311830b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:25.259590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-88b2ced4-08f6-465a-932f-4bf4311830b2 None None] MFA Rules not processed for user `a89eb76296d04adf8cc9b24ef0165ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:25.260913 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-88b2ced4-08f6-465a-932f-4bf4311830b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:25.324714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1106/2250] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:25.329062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec196d-6972-4068-8973-a764bdeb4b59 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:25.338505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:25.391210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec196d-6972-4068-8973-a764bdeb4b59 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:25.396064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2447e0-d9a2-4e25-84cd-4996332db90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:25.396744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2447e0-d9a2-4e25-84cd-4996332db90d admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:25.397028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2447e0-d9a2-4e25-84cd-4996332db90d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:25.397304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2447e0-d9a2-4e25-84cd-4996332db90d admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:25.397999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2447e0-d9a2-4e25-84cd-4996332db90d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:25.400006 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2447e0-d9a2-4e25-84cd-4996332db90d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:25.479826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1145/2251] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:04:25 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:25.483784 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2ced4-08f6-465a-932f-4bf4311830b2 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:25.495532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2ced4-08f6-465a-932f-4bf4311830b2 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:25.548898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ee777-e65a-45d3-a774-ff5852cadd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:25.549556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ee777-e65a-45d3-a774-ff5852cadd32 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:25.549838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ee777-e65a-45d3-a774-ff5852cadd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:25.550113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ee777-e65a-45d3-a774-ff5852cadd32 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:25.550807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ee777-e65a-45d3-a774-ff5852cadd32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:25.552743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ee777-e65a-45d3-a774-ff5852cadd32 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:25.629112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1107/2252] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:04:25 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:25.633044 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2447e0-d9a2-4e25-84cd-4996332db90d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:25.643644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2447e0-d9a2-4e25-84cd-4996332db90d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:25.649257 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7ff1-9466-4ecc-9669-6fef4806f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:25.652457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7ff1-9466-4ecc-9669-6fef4806f497 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:25.652457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7ff1-9466-4ecc-9669-6fef4806f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:25.652457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec7ff1-9466-4ecc-9669-6fef4806f497 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:25.652457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7ff1-9466-4ecc-9669-6fef4806f497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:25.654561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec7ff1-9466-4ecc-9669-6fef4806f497 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:25.671418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1146/2253] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:04:25.672610 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ee777-e65a-45d3-a774-ff5852cadd32 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:25.690175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ee777-e65a-45d3-a774-ff5852cadd32 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:25.695081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4092937-f6bb-4a21-96cc-59886291dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:25.695751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4092937-f6bb-4a21-96cc-59886291dc3b admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:25.696032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4092937-f6bb-4a21-96cc-59886291dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:25.696308 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4092937-f6bb-4a21-96cc-59886291dc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:25.697068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4092937-f6bb-4a21-96cc-59886291dc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:25.698845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4092937-f6bb-4a21-96cc-59886291dc3b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:25.709700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1108/2254] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:04:25.721432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7ff1-9466-4ecc-9669-6fef4806f497 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:25.731989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec7ff1-9466-4ecc-9669-6fef4806f497 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:25.736841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40905881-b087-4324-96dd-483c9851da27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:25.737716 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40905881-b087-4324-96dd-483c9851da27 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:25.737997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40905881-b087-4324-96dd-483c9851da27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:25.738274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40905881-b087-4324-96dd-483c9851da27 admin admin] PATH_INFO: `/v3/projects/270b9dd7ab4e49e6a3eeabc48c500d66/users/5990905d097d49e2b98495e14831cdb8/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:25.754353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40905881-b087-4324-96dd-483c9851da27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270b9dd7ab4e49e6a3eeabc48c500d66, user_id=5990905d097d49e2b98495e14831cdb8, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:25.757073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40905881-b087-4324-96dd-483c9851da27 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:25.841111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1147/2255] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:04:25 2022] PUT /identity/v3/projects/270b9dd7ab4e49e6a3eeabc48c500d66/users/5990905d097d49e2b98495e14831cdb8/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:25.846585 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd1d0d-3932-47d4-9d81-4af1b96c0472 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:25.846879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd1d0d-3932-47d4-9d81-4af1b96c0472 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:25.847193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd1d0d-3932-47d4-9d81-4af1b96c0472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:25.853617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:25.876190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f4dd1d0d-3932-47d4-9d81-4af1b96c0472 None None] MFA Rules not processed for user `5990905d097d49e2b98495e14831cdb8`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:25.877502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f4dd1d0d-3932-47d4-9d81-4af1b96c0472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:25.943036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1109/2256] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:25.948290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40905881-b087-4324-96dd-483c9851da27 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:26.013750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40905881-b087-4324-96dd-483c9851da27 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:26.018538 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670a718-8cd8-479b-b044-56c3a2540b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:26.019232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670a718-8cd8-479b-b044-56c3a2540b28 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:26.019516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670a718-8cd8-479b-b044-56c3a2540b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:26.019794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670a718-8cd8-479b-b044-56c3a2540b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:26.020479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670a718-8cd8-479b-b044-56c3a2540b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:26.022377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670a718-8cd8-479b-b044-56c3a2540b28 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:26.111715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1148/2257] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:04:25 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:26.115853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd1d0d-3932-47d4-9d81-4af1b96c0472 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:26.128066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd1d0d-3932-47d4-9d81-4af1b96c0472 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:26.184997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bdcc8-82b2-43b8-b593-a07181024949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:26.185676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bdcc8-82b2-43b8-b593-a07181024949 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:26.185962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bdcc8-82b2-43b8-b593-a07181024949 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:26.186238 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4bdcc8-82b2-43b8-b593-a07181024949 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:26.186925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bdcc8-82b2-43b8-b593-a07181024949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:26.188878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4bdcc8-82b2-43b8-b593-a07181024949 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:26.280222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1110/2258] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:04:26 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:04:26.280307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670a718-8cd8-479b-b044-56c3a2540b28 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:26.295961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670a718-8cd8-479b-b044-56c3a2540b28 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:26.300784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6795f-1f44-474e-8fcf-1c362874bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:26.301623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6795f-1f44-474e-8fcf-1c362874bd22 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:26.301915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6795f-1f44-474e-8fcf-1c362874bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:26.302222 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6795f-1f44-474e-8fcf-1c362874bd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:26.302923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6795f-1f44-474e-8fcf-1c362874bd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:26.304582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6795f-1f44-474e-8fcf-1c362874bd22 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:26.316668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1149/2259] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:04:26.320860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bdcc8-82b2-43b8-b593-a07181024949 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:26.333212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4bdcc8-82b2-43b8-b593-a07181024949 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:26.338904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5e3d9-5676-4869-b50e-89a152bda3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:26.339925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5e3d9-5676-4869-b50e-89a152bda3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:26.340270 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5e3d9-5676-4869-b50e-89a152bda3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:26.340555 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5e3d9-5676-4869-b50e-89a152bda3b1 admin admin] PATH_INFO: `/v3/projects/ddf11cd67d15469bbbd2cf23ae8d2289/users/16faeb2747d3459e8f2a1b547d0eaf60/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:26.357179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5e3d9-5676-4869-b50e-89a152bda3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf11cd67d15469bbbd2cf23ae8d2289, user_id=16faeb2747d3459e8f2a1b547d0eaf60, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:26.359899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5e3d9-5676-4869-b50e-89a152bda3b1 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:26.459609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1111/2260] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:04:26 2022] PUT /identity/v3/projects/ddf11cd67d15469bbbd2cf23ae8d2289/users/16faeb2747d3459e8f2a1b547d0eaf60/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:26.463598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6795f-1f44-474e-8fcf-1c362874bd22 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:26.473547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6795f-1f44-474e-8fcf-1c362874bd22 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:26.503255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:26.529878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3a7ce-8f92-4dee-a67c-34578ede164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:26.530474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a7ce-8f92-4dee-a67c-34578ede164d admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:26.530761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a7ce-8f92-4dee-a67c-34578ede164d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:26.531070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3a7ce-8f92-4dee-a67c-34578ede164d admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:26.531792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3a7ce-8f92-4dee-a67c-34578ede164d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:26.533374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3a7ce-8f92-4dee-a67c-34578ede164d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:26.543525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1150/2261] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:04:26.547915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5e3d9-5676-4869-b50e-89a152bda3b1 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:26.558949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5e3d9-5676-4869-b50e-89a152bda3b1 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:26.563896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204c47d-3040-4e29-a75f-e8919c5f5fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:26.564778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204c47d-3040-4e29-a75f-e8919c5f5fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:26.565064 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204c47d-3040-4e29-a75f-e8919c5f5fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:26.565338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204c47d-3040-4e29-a75f-e8919c5f5fdd admin admin] PATH_INFO: `/v3/projects/ddf11cd67d15469bbbd2cf23ae8d2289/users/16faeb2747d3459e8f2a1b547d0eaf60/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:26.567411 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204c47d-3040-4e29-a75f-e8919c5f5fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf11cd67d15469bbbd2cf23ae8d2289, user_id=16faeb2747d3459e8f2a1b547d0eaf60, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:26.570081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204c47d-3040-4e29-a75f-e8919c5f5fdd admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:26.580962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1112/2262] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:04:26 2022] PUT /identity/v3/projects/ddf11cd67d15469bbbd2cf23ae8d2289/users/16faeb2747d3459e8f2a1b547d0eaf60/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:04:26.590871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61449bc7-7392-4d29-85fd-af68c96b6f7c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:26.595910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61449bc7-7392-4d29-85fd-af68c96b6f7c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:26.595910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61449bc7-7392-4d29-85fd-af68c96b6f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:26.617915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-61449bc7-7392-4d29-85fd-af68c96b6f7c None None] MFA Rules not processed for user `16faeb2747d3459e8f2a1b547d0eaf60`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:26.619761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-61449bc7-7392-4d29-85fd-af68c96b6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:26.689370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1151/2263] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:26.701580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204c47d-3040-4e29-a75f-e8919c5f5fdd admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:26.704626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a204c47d-3040-4e29-a75f-e8919c5f5fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:26.757831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:26.768871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204c47d-3040-4e29-a75f-e8919c5f5fdd admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:26.772837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09785c2-e72a-42a0-8e9b-affded7542d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:26.773619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09785c2-e72a-42a0-8e9b-affded7542d8 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:26.773877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09785c2-e72a-42a0-8e9b-affded7542d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:26.774150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09785c2-e72a-42a0-8e9b-affded7542d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:26.841755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09785c2-e72a-42a0-8e9b-affded7542d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:26.843374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09785c2-e72a-42a0-8e9b-affded7542d8 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:26.853813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1113/2264] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:30.098509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61449bc7-7392-4d29-85fd-af68c96b6f7c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:30.109226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61449bc7-7392-4d29-85fd-af68c96b6f7c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:30.112919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac077e1-9ce5-480d-b714-a446976d108e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:30.113551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac077e1-9ce5-480d-b714-a446976d108e service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:30.113837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac077e1-9ce5-480d-b714-a446976d108e service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:30.116004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac077e1-9ce5-480d-b714-a446976d108e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:30.174150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac077e1-9ce5-480d-b714-a446976d108e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:30.175640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac077e1-9ce5-480d-b714-a446976d108e service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:30.186711 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1152/2265] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:31.799261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09785c2-e72a-42a0-8e9b-affded7542d8 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:31.811563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09785c2-e72a-42a0-8e9b-affded7542d8 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:31.816309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda005dd-7934-46b7-a19f-0b7bcf076296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:31.817522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda005dd-7934-46b7-a19f-0b7bcf076296 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:31.817522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda005dd-7934-46b7-a19f-0b7bcf076296 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:31.817996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda005dd-7934-46b7-a19f-0b7bcf076296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:31.829374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda005dd-7934-46b7-a19f-0b7bcf076296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:31.831139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda005dd-7934-46b7-a19f-0b7bcf076296 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:31.840936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1114/2266] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:04:34.505198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00066-f42e-42f4-907a-d35b839b60c5 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:34.505705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00066-f42e-42f4-907a-d35b839b60c5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:34.505799 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00066-f42e-42f4-907a-d35b839b60c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:34.524258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-16a00066-f42e-42f4-907a-d35b839b60c5 None None] MFA Rules not processed for user `2e7ba82a80834a4aa098e9604165cfad`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:34.525602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-16a00066-f42e-42f4-907a-d35b839b60c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:34.576839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:34.592690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1153/2267] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:35.151167 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a713d8-921c-4047-aac0-985f50abde8b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:35.151643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a713d8-921c-4047-aac0-985f50abde8b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:35.151736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a713d8-921c-4047-aac0-985f50abde8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:35.169222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-65a713d8-921c-4047-aac0-985f50abde8b None None] MFA Rules not processed for user `604055ba289b4381bc1cc6b5d238999b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:35.170419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-65a713d8-921c-4047-aac0-985f50abde8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:35.235436 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1115/2268] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:38.406536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00066-f42e-42f4-907a-d35b839b60c5 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:38.471965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00066-f42e-42f4-907a-d35b839b60c5 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:38.476651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:38.477566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:38.477877 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:38.478157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] PATH_INFO: `/v3/users/a89eb76296d04adf8cc9b24ef0165ec8` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:38.479423 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89eb76296d04adf8cc9b24ef0165ec8)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:38.481362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:38.733999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89eb76296d04adf8cc9b24ef0165ec8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:38.734651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89eb76296d04adf8cc9b24ef0165ec8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:38.735276 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89eb76296d04adf8cc9b24ef0165ec8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:38.853742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89eb76296d04adf8cc9b24ef0165ec8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:38.862144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89eb76296d04adf8cc9b24ef0165ec8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:38.881698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1154/2269] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:04:38 2022] DELETE /identity/v3/users/a89eb76296d04adf8cc9b24ef0165ec8 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:38.892380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58c11-777b-4188-9c8e-f9bad5913614 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:38.892380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58c11-777b-4188-9c8e-f9bad5913614 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:38.892380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58c11-777b-4188-9c8e-f9bad5913614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:38.907628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-9ad58c11-777b-4188-9c8e-f9bad5913614 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:38.909643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9ad58c11-777b-4188-9c8e-f9bad5913614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:38.986166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1116/2270] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:38.996435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:38.997920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:39.061026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b443bc6-671b-43a6-ac05-0622d5bc87c5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:39.064653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2ba24-af1a-420b-b632-691fef0fb4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:39.065299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2ba24-af1a-420b-b632-691fef0fb4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:39.065576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2ba24-af1a-420b-b632-691fef0fb4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:39.065848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2ba24-af1a-420b-b632-691fef0fb4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:39.075325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2ba24-af1a-420b-b632-691fef0fb4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:39.085693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2ba24-af1a-420b-b632-691fef0fb4b8 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:39.087021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1155/2271] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:04:39.667441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58c11-777b-4188-9c8e-f9bad5913614 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:39.668983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9ad58c11-777b-4188-9c8e-f9bad5913614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:39.683403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58c11-777b-4188-9c8e-f9bad5913614 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:39.688499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:39.689778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:39.690145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:39.690424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] PATH_INFO: `/v3/projects/c518f7a073eb4335b403743a602c60ad` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:39.692043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c518f7a073eb4335b403743a602c60ad)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:39.694573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:39.884573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:39.904524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c518f7a073eb4335b403743a602c60ad', 'request_id': 'req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:39.912474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c518f7a073eb4335b403743a602c60ad', 'request_id': 'req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:39.923664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c518f7a073eb4335b403743a602c60ad', 'request_id': 'req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:40.033680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] The token cache is being invalidate because project c518f7a073eb4335b403743a602c60ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:04:40.033680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:40.033680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:40.033680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1117/2272] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:04:39 2022] DELETE /identity/v3/projects/c518f7a073eb4335b403743a602c60ad => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:40.036377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2ba24-af1a-420b-b632-691fef0fb4b8 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:40.046348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2ba24-af1a-420b-b632-691fef0fb4b8 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:40.059708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:40.113663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:40.114896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:40.115561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:40.116021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] PATH_INFO: `/v3/users/5990905d097d49e2b98495e14831cdb8` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:40.117561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5990905d097d49e2b98495e14831cdb8)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:40.120284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:40.417465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5990905d097d49e2b98495e14831cdb8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:40.423031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5990905d097d49e2b98495e14831cdb8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:40.423031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5990905d097d49e2b98495e14831cdb8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:40.554085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5990905d097d49e2b98495e14831cdb8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:40.554085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5990905d097d49e2b98495e14831cdb8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:40.573100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1156/2273] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:04:40 2022] DELETE /identity/v3/users/5990905d097d49e2b98495e14831cdb8 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:41.110376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:41.113430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:41.125829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00018e8-f3b0-4ff2-9aa6-d32ec5f89c5d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:41.209818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:41.216105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:41.216105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:41.216105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] PATH_INFO: `/v3/projects/270b9dd7ab4e49e6a3eeabc48c500d66` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:41.216105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270b9dd7ab4e49e6a3eeabc48c500d66)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:41.216105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:41.436902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270b9dd7ab4e49e6a3eeabc48c500d66', 'request_id': 'req-87b546e8-1421-4f14-99fb-329bab49e2f4'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:41.442902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270b9dd7ab4e49e6a3eeabc48c500d66', 'request_id': 'req-87b546e8-1421-4f14-99fb-329bab49e2f4'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:41.451028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270b9dd7ab4e49e6a3eeabc48c500d66', 'request_id': 'req-87b546e8-1421-4f14-99fb-329bab49e2f4'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:41.665631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] The token cache is being invalidate because project 270b9dd7ab4e49e6a3eeabc48c500d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:04:41.666148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:41.667311 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:41.673699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1118/2274] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:04:41 2022] DELETE /identity/v3/projects/270b9dd7ab4e49e6a3eeabc48c500d66 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:41.674096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:41.675658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:41.692915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3ce7b-5f96-4b13-aebe-2eb740783f1a admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:41.753314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:41.754205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:41.754486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:41.754746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] PATH_INFO: `/v3/users/16faeb2747d3459e8f2a1b547d0eaf60` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:41.756027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16faeb2747d3459e8f2a1b547d0eaf60)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:41.757966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:41.977531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:41.985270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16faeb2747d3459e8f2a1b547d0eaf60'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:41.985969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16faeb2747d3459e8f2a1b547d0eaf60'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:41.986649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16faeb2747d3459e8f2a1b547d0eaf60'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:42.057571 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16faeb2747d3459e8f2a1b547d0eaf60'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:42.065073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4aa917be-ad52-457c-abbc-7546c0af4c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16faeb2747d3459e8f2a1b547d0eaf60'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:42.083751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1157/2275] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:04:41 2022] DELETE /identity/v3/users/16faeb2747d3459e8f2a1b547d0eaf60 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:42.933613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:04:42.935900 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:42.950616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b546e8-1421-4f14-99fb-329bab49e2f4 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:04:42.995174 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:43.010796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:04:43.011705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:43.015954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:43.015954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] PATH_INFO: `/v3/projects/ddf11cd67d15469bbbd2cf23ae8d2289` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:43.015954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf11cd67d15469bbbd2cf23ae8d2289)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:04:43.015954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:04:43.177896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf11cd67d15469bbbd2cf23ae8d2289', 'request_id': 'req-2d6c572e-df76-4b35-b304-9827b47af429'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:43.184297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf11cd67d15469bbbd2cf23ae8d2289', 'request_id': 'req-2d6c572e-df76-4b35-b304-9827b47af429'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:43.191452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf11cd67d15469bbbd2cf23ae8d2289', 'request_id': 'req-2d6c572e-df76-4b35-b304-9827b47af429'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:43.277912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] The token cache is being invalidate because project ddf11cd67d15469bbbd2cf23ae8d2289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:04:43.280314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:43.281380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2d6c572e-df76-4b35-b304-9827b47af429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:04:43.284915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1119/2276] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:04:42 2022] DELETE /identity/v3/projects/ddf11cd67d15469bbbd2cf23ae8d2289 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:04:46.236845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487913-8ee5-4dbf-bfb0-4eb8bdba0660 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:04:46.237314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487913-8ee5-4dbf-bfb0-4eb8bdba0660 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:04:46.237404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487913-8ee5-4dbf-bfb0-4eb8bdba0660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:04:46.255611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-32487913-8ee5-4dbf-bfb0-4eb8bdba0660 None None] MFA Rules not processed for user `94954697f2ba4d94bf0b7d55c4c1beb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:04:46.256837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-32487913-8ee5-4dbf-bfb0-4eb8bdba0660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:04:46.319104 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1158/2277] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:04:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:04:54.314600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:04:56.312171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:DELETE=5,keystone:SELECT=39,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:05:00.360174 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ba90f-3920-4036-9fd9-869b0a8ab099 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:00.360711 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ba90f-3920-4036-9fd9-869b0a8ab099 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:00.360711 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ba90f-3920-4036-9fd9-869b0a8ab099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:00.423790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ed5ba90f-3920-4036-9fd9-869b0a8ab099 None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:05:00.424992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ed5ba90f-3920-4036-9fd9-869b0a8ab099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:00.503848 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1120/2278] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:05:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:05:00.557664 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487913-8ee5-4dbf-bfb0-4eb8bdba0660 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:00.559122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-32487913-8ee5-4dbf-bfb0-4eb8bdba0660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:00.658472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487913-8ee5-4dbf-bfb0-4eb8bdba0660 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:00.663430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c193a-e7d3-4322-bda6-94f91ecd2523 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:00.664127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c193a-e7d3-4322-bda6-94f91ecd2523 service swift] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:00.664442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c193a-e7d3-4322-bda6-94f91ecd2523 service swift] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:00.664841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c193a-e7d3-4322-bda6-94f91ecd2523 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:00.673312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c193a-e7d3-4322-bda6-94f91ecd2523 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:00.675143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c193a-e7d3-4322-bda6-94f91ecd2523 service swift] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:00.683823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1159/2279] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:05:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:05:10.492293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=40 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:05:10.680142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=41 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:05:15.970508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bb81a-d8af-4da9-bd98-840b18faef27 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:15.970992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bb81a-d8af-4da9-bd98-840b18faef27 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:15.971097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bb81a-d8af-4da9-bd98-840b18faef27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:15.991066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-e76bb81a-d8af-4da9-bd98-840b18faef27 None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:05:15.992309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e76bb81a-d8af-4da9-bd98-840b18faef27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:16.000296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1121/2280] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:05:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:05:16.012487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c193a-e7d3-4322-bda6-94f91ecd2523 service swift] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:16.023055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c193a-e7d3-4322-bda6-94f91ecd2523 service swift] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:16.028459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4fe271-c940-4f6d-8142-9d0213154fa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:16.029101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fe271-c940-4f6d-8142-9d0213154fa6 service swift] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:16.029381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fe271-c940-4f6d-8142-9d0213154fa6 service swift] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:16.029657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4fe271-c940-4f6d-8142-9d0213154fa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:16.038657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fe271-c940-4f6d-8142-9d0213154fa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:16.040233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4fe271-c940-4f6d-8142-9d0213154fa6 service swift] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:16.050763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1160/2281] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:05:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:05:23.797819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95e6f-ee96-43ee-9a99-ecde383ce449 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:23.798405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95e6f-ee96-43ee-9a99-ecde383ce449 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:23.798405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe95e6f-ee96-43ee-9a99-ecde383ce449 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:23.800083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1122/2282] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:05:23.807229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c72721-8f2f-4ea5-8ac0-c4663b73e90a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:23.808153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c72721-8f2f-4ea5-8ac0-c4663b73e90a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:23.808588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c72721-8f2f-4ea5-8ac0-c4663b73e90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:23.870990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a8c72721-8f2f-4ea5-8ac0-c4663b73e90a None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:05:23.872718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a8c72721-8f2f-4ea5-8ac0-c4663b73e90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:24.005629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1161/2283] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:05:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:05:24.018930 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe95e6f-ee96-43ee-9a99-ecde383ce449 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:24.020837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-dfe95e6f-ee96-43ee-9a99-ecde383ce449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:24.136465 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe95e6f-ee96-43ee-9a99-ecde383ce449 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:24.139450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dde634-3ed9-46b2-afb7-9ace36beff69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb36541c7ba418a843e5ecbb1f1e337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:24.140201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dde634-3ed9-46b2-afb7-9ace36beff69 service glance] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:24.140486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dde634-3ed9-46b2-afb7-9ace36beff69 service glance] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:24.140757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dde634-3ed9-46b2-afb7-9ace36beff69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:24.155820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dde634-3ed9-46b2-afb7-9ace36beff69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:24.157375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dde634-3ed9-46b2-afb7-9ace36beff69 service glance] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:24.171607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1123/2284] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:05:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:05:24.413328 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a58987-c9a3-4074-8446-641ad9c957ba None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:24.413655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a58987-c9a3-4074-8446-641ad9c957ba None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:24.413938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a58987-c9a3-4074-8446-641ad9c957ba None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:24.415736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1162/2285] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:05:24.421243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e169ea-5aa0-42ff-a450-ea1381025a62 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:24.421656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e169ea-5aa0-42ff-a450-ea1381025a62 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:24.422036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e169ea-5aa0-42ff-a450-ea1381025a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:24.444275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-12e169ea-5aa0-42ff-a450-ea1381025a62 None None] MFA Rules not processed for user `7afc19dc502f425faf693eb963fe63d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:05:24.446272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-12e169ea-5aa0-42ff-a450-ea1381025a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:24.526630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1124/2286] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:05:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:05:24.539535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a58987-c9a3-4074-8446-641ad9c957ba None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:24.546468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f6a58987-c9a3-4074-8446-641ad9c957ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:24.557159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a58987-c9a3-4074-8446-641ad9c957ba None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:24.561102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb1495-09e8-4ec7-9028-33b4b199a765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:24.561748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb1495-09e8-4ec7-9028-33b4b199a765 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:24.562026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb1495-09e8-4ec7-9028-33b4b199a765 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:24.562305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb1495-09e8-4ec7-9028-33b4b199a765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:24.574128 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb1495-09e8-4ec7-9028-33b4b199a765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:24.575608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb1495-09e8-4ec7-9028-33b4b199a765 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:24.585509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1163/2287] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:05:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:05:24.688134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05910296-f6ac-4d18-b1d9-bd1ae586b289 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:24.688437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05910296-f6ac-4d18-b1d9-bd1ae586b289 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:24.688756 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05910296-f6ac-4d18-b1d9-bd1ae586b289 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:24.690232 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1125/2288] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:05:24.699451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2bc59-a2ac-42a8-be62-4770c9840f8d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:24.699750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2bc59-a2ac-42a8-be62-4770c9840f8d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:24.700159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2bc59-a2ac-42a8-be62-4770c9840f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:24.725145 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-03c2bc59-a2ac-42a8-be62-4770c9840f8d None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:05:24.727290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-03c2bc59-a2ac-42a8-be62-4770c9840f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:24.745193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1164/2289] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:05:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:05:24.757905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05910296-f6ac-4d18-b1d9-bd1ae586b289 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:24.771524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05910296-f6ac-4d18-b1d9-bd1ae586b289 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:24.777851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ad930-f5d7-4396-8674-83ef1415b388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:24.778654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ad930-f5d7-4396-8674-83ef1415b388 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:24.778952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ad930-f5d7-4396-8674-83ef1415b388 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:24.779447 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ad930-f5d7-4396-8674-83ef1415b388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:24.800580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ad930-f5d7-4396-8674-83ef1415b388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:24.802263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ad930-f5d7-4396-8674-83ef1415b388 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:24.829657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1126/2290] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:05:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:05:29.786956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95eed0-0d54-4f37-880e-de27a0eec52b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:29.787515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95eed0-0d54-4f37-880e-de27a0eec52b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:29.787668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95eed0-0d54-4f37-880e-de27a0eec52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:29.806836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-df95eed0-0d54-4f37-880e-de27a0eec52b None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:05:29.808181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-df95eed0-0d54-4f37-880e-de27a0eec52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:29.819253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1165/2291] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:05:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:05:29.834087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ad930-f5d7-4396-8674-83ef1415b388 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:29.847253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ad930-f5d7-4396-8674-83ef1415b388 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:29.853123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce580707-9531-4473-ac9a-216541c4a8a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:29.853811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce580707-9531-4473-ac9a-216541c4a8a8 service swift] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:29.854069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce580707-9531-4473-ac9a-216541c4a8a8 service swift] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:29.854348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce580707-9531-4473-ac9a-216541c4a8a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:29.863855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce580707-9531-4473-ac9a-216541c4a8a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:29.865583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce580707-9531-4473-ac9a-216541c4a8a8 service swift] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:29.875287 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1127/2292] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:05:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:05:34.317477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994d43a-9241-4e6d-84ff-aacb8a501518 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:34.318049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994d43a-9241-4e6d-84ff-aacb8a501518 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:34.318049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994d43a-9241-4e6d-84ff-aacb8a501518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:34.337916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-1994d43a-9241-4e6d-84ff-aacb8a501518 None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:05:34.339163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1994d43a-9241-4e6d-84ff-aacb8a501518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:34.353983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1166/2293] 10.222.0.42 () {58 vars in 967 bytes} [Fri May 27 14:05:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:05:34.369457 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce580707-9531-4473-ac9a-216541c4a8a8 service swift] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:34.381652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce580707-9531-4473-ac9a-216541c4a8a8 service swift] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:34.388704 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22c16-638f-432a-93bb-28e47a68e52e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:34.389740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22c16-638f-432a-93bb-28e47a68e52e service swift] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:34.390288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22c16-638f-432a-93bb-28e47a68e52e service swift] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:34.391028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf22c16-638f-432a-93bb-28e47a68e52e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:34.405348 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf22c16-638f-432a-93bb-28e47a68e52e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:34.407908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf22c16-638f-432a-93bb-28e47a68e52e service swift] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:34.418637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1128/2294] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:05:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:05:38.606960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994d43a-9241-4e6d-84ff-aacb8a501518 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:38.612763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1994d43a-9241-4e6d-84ff-aacb8a501518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:38.677020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994d43a-9241-4e6d-84ff-aacb8a501518 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:38.681868 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:38.682739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:38.683081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:38.683357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] PATH_INFO: `/v3/users/604055ba289b4381bc1cc6b5d238999b` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:38.684589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=604055ba289b4381bc1cc6b5d238999b)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:38.686556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:38.886843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:05:38.895800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604055ba289b4381bc1cc6b5d238999b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:05:38.896454 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604055ba289b4381bc1cc6b5d238999b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:05:38.897055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604055ba289b4381bc1cc6b5d238999b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:05:39.012379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604055ba289b4381bc1cc6b5d238999b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:05:39.020608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-e0266455-f978-4c2c-8b61-a07a0da7dc66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604055ba289b4381bc1cc6b5d238999b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:05:39.041384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1167/2295] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:05:38 2022] DELETE /identity/v3/users/604055ba289b4381bc1cc6b5d238999b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:05:39.361446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22c16-638f-432a-93bb-28e47a68e52e service swift] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:39.373294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf22c16-638f-432a-93bb-28e47a68e52e service swift] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:39.419433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:05:39.431873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:39.433689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:39.433689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:39.433689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] PATH_INFO: `/v3/projects/105f50511dc34ef898fcc00fb3db837f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:39.434615 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105f50511dc34ef898fcc00fb3db837f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:39.436573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:39.550826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105f50511dc34ef898fcc00fb3db837f', 'request_id': 'req-23934302-c1ac-46f4-a5e1-eec47b3ed640'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:05:39.557206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105f50511dc34ef898fcc00fb3db837f', 'request_id': 'req-23934302-c1ac-46f4-a5e1-eec47b3ed640'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:05:39.563674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105f50511dc34ef898fcc00fb3db837f', 'request_id': 'req-23934302-c1ac-46f4-a5e1-eec47b3ed640'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:05:39.675549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] The token cache is being invalidate because project 105f50511dc34ef898fcc00fb3db837f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:05:39.675852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:05:39.676477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-23934302-c1ac-46f4-a5e1-eec47b3ed640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:05:39.678136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1129/2296] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:05:39 2022] DELETE /identity/v3/projects/105f50511dc34ef898fcc00fb3db837f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:05:39.683948 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c0fcd-af3d-4f56-bc2c-956d9e0d264a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:39.684450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c0fcd-af3d-4f56-bc2c-956d9e0d264a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:39.684568 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c0fcd-af3d-4f56-bc2c-956d9e0d264a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:39.704418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-e86c0fcd-af3d-4f56-bc2c-956d9e0d264a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:05:39.705610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-e86c0fcd-af3d-4f56-bc2c-956d9e0d264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:39.770290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1168/2297] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:05:39.778250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854daa-ce97-42fc-836a-0e21af2fad79 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:39.778574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854daa-ce97-42fc-836a-0e21af2fad79 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:39.778856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854daa-ce97-42fc-836a-0e21af2fad79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:39.798523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4e854daa-ce97-42fc-836a-0e21af2fad79 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:05:39.800417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4e854daa-ce97-42fc-836a-0e21af2fad79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:39.815206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1130/2298] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:05:39.816831 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c0fcd-af3d-4f56-bc2c-956d9e0d264a None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:39.828649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c0fcd-af3d-4f56-bc2c-956d9e0d264a None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:39.833617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f980c1-542f-477c-9ea7-b2046436af8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:39.834417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f980c1-542f-477c-9ea7-b2046436af8c admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:39.834705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f980c1-542f-477c-9ea7-b2046436af8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:39.834993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f980c1-542f-477c-9ea7-b2046436af8c admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:39.835797 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f980c1-542f-477c-9ea7-b2046436af8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:05:39.836240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f980c1-542f-477c-9ea7-b2046436af8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:39.837862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f980c1-542f-477c-9ea7-b2046436af8c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:39.850643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1169/2299] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:05:39.855590 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e854daa-ce97-42fc-836a-0e21af2fad79 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:39.864966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e854daa-ce97-42fc-836a-0e21af2fad79 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:39.870639 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a23d5-6fe0-439b-91d5-b1e9eef3f4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:39.871320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a23d5-6fe0-439b-91d5-b1e9eef3f4ec admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:39.871606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a23d5-6fe0-439b-91d5-b1e9eef3f4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:39.871882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a23d5-6fe0-439b-91d5-b1e9eef3f4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:39.872585 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a23d5-6fe0-439b-91d5-b1e9eef3f4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:39.874499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a23d5-6fe0-439b-91d5-b1e9eef3f4ec admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:39.989599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1131/2300] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:05:39 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:05:39.994507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f980c1-542f-477c-9ea7-b2046436af8c admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:40.004641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f980c1-542f-477c-9ea7-b2046436af8c admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:40.060459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525001c-17cc-470c-ad58-f50cf891c788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:40.060920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525001c-17cc-470c-ad58-f50cf891c788 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:40.061214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525001c-17cc-470c-ad58-f50cf891c788 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:40.061508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525001c-17cc-470c-ad58-f50cf891c788 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:40.062193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525001c-17cc-470c-ad58-f50cf891c788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:40.064184 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525001c-17cc-470c-ad58-f50cf891c788 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:40.202708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1170/2301] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:05:39 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:05:40.207263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a23d5-6fe0-439b-91d5-b1e9eef3f4ec admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:40.218288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a23d5-6fe0-439b-91d5-b1e9eef3f4ec admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:40.222879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5368f3-4752-4c52-9f4e-15656714e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:40.223661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5368f3-4752-4c52-9f4e-15656714e194 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:40.223945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5368f3-4752-4c52-9f4e-15656714e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:40.224224 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5368f3-4752-4c52-9f4e-15656714e194 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:40.224956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5368f3-4752-4c52-9f4e-15656714e194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:40.226651 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5368f3-4752-4c52-9f4e-15656714e194 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:40.238512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1132/2302] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:05:40.243320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525001c-17cc-470c-ad58-f50cf891c788 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:40.253323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525001c-17cc-470c-ad58-f50cf891c788 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:40.259143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ce435-466d-4ce9-b84a-2e164990ca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:40.259820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ce435-466d-4ce9-b84a-2e164990ca92 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:40.260088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ce435-466d-4ce9-b84a-2e164990ca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:40.260366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ce435-466d-4ce9-b84a-2e164990ca92 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:40.261096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ce435-466d-4ce9-b84a-2e164990ca92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:40.262793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ce435-466d-4ce9-b84a-2e164990ca92 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:40.272924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1171/2303] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:05:40.277105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5368f3-4752-4c52-9f4e-15656714e194 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:40.286843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5368f3-4752-4c52-9f4e-15656714e194 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:40.291533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5868-1373-40d7-bd2d-930494135905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:40.292401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5868-1373-40d7-bd2d-930494135905 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:40.292685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5868-1373-40d7-bd2d-930494135905 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:40.292963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5868-1373-40d7-bd2d-930494135905 admin admin] PATH_INFO: `/v3/projects/1fd1c490dc8d494491152dbfe1020633/users/ac543734e22343939d28e18befbcda7d/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:40.309280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa5868-1373-40d7-bd2d-930494135905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd1c490dc8d494491152dbfe1020633, user_id=ac543734e22343939d28e18befbcda7d, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:40.311955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa5868-1373-40d7-bd2d-930494135905 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:40.437570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1133/2304] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:05:40 2022] PUT /identity/v3/projects/1fd1c490dc8d494491152dbfe1020633/users/ac543734e22343939d28e18befbcda7d/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:05:40.447786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe396-d834-46f4-bbad-8eda39d64652 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:40.448157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe396-d834-46f4-bbad-8eda39d64652 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:40.448502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe396-d834-46f4-bbad-8eda39d64652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:40.482176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-4afbe396-d834-46f4-bbad-8eda39d64652 None None] MFA Rules not processed for user `ac543734e22343939d28e18befbcda7d`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:05:40.483447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4afbe396-d834-46f4-bbad-8eda39d64652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:40.488596 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:05:40.547116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1172/2305] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:05:40.559063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5868-1373-40d7-bd2d-930494135905 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:05:40.560882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f0aa5868-1373-40d7-bd2d-930494135905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:05:40.618677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5868-1373-40d7-bd2d-930494135905 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:05:40.622398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c1a20-8215-4553-9443-04df0f2ccb0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb36541c7ba418a843e5ecbb1f1e337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:05:40.623063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c1a20-8215-4553-9443-04df0f2ccb0b service glance] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:05:40.626497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c1a20-8215-4553-9443-04df0f2ccb0b service glance] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:05:40.626497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c1a20-8215-4553-9443-04df0f2ccb0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:05:40.631809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c1a20-8215-4553-9443-04df0f2ccb0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:05:40.633897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c1a20-8215-4553-9443-04df0f2ccb0b service glance] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:05:40.643031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1134/2306] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:05:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:05:50.638729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:05:50.680939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=24 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:06:04.272471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe396-d834-46f4-bbad-8eda39d64652 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:04.274391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4afbe396-d834-46f4-bbad-8eda39d64652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:04.329936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe396-d834-46f4-bbad-8eda39d64652 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:04.333845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6beb3-2c26-4f44-8ab1-e0212bee3f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:04.334494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6beb3-2c26-4f44-8ab1-e0212bee3f55 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:04.334776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6beb3-2c26-4f44-8ab1-e0212bee3f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:04.335081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6beb3-2c26-4f44-8ab1-e0212bee3f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:04.337491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5fa6beb3-2c26-4f44-8ab1-e0212bee3f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:04.407501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6beb3-2c26-4f44-8ab1-e0212bee3f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:04.408931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6beb3-2c26-4f44-8ab1-e0212bee3f55 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:04.421357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1173/2307] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:06:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:06:04.453433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb0685-cd52-4f19-acfa-fbcb335e2daf None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:04.453941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb0685-cd52-4f19-acfa-fbcb335e2daf None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:04.454047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb0685-cd52-4f19-acfa-fbcb335e2daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:04.471389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-aedb0685-cd52-4f19-acfa-fbcb335e2daf None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:06:04.472604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-aedb0685-cd52-4f19-acfa-fbcb335e2daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:04.530287 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1135/2308] 10.222.0.42 () {58 vars in 967 bytes} [Fri May 27 14:06:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:06:04.551883 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6beb3-2c26-4f44-8ab1-e0212bee3f55 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:04.553367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5fa6beb3-2c26-4f44-8ab1-e0212bee3f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:04.623166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6beb3-2c26-4f44-8ab1-e0212bee3f55 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:04.628319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363df70-61be-4695-8d3a-9914a85b09c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:04.628967 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363df70-61be-4695-8d3a-9914a85b09c7 service swift] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:04.629252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363df70-61be-4695-8d3a-9914a85b09c7 service swift] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:04.629532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363df70-61be-4695-8d3a-9914a85b09c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:04.637825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363df70-61be-4695-8d3a-9914a85b09c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:04.639438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363df70-61be-4695-8d3a-9914a85b09c7 service swift] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:04.647581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1174/2309] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:06:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:06:05.600310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb0685-cd52-4f19-acfa-fbcb335e2daf None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:05.601814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-aedb0685-cd52-4f19-acfa-fbcb335e2daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:05.613083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb0685-cd52-4f19-acfa-fbcb335e2daf None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:05.616662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff7e6c-13bf-4d99-9b1a-d6f73edfdd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:05.617782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7e6c-13bf-4d99-9b1a-d6f73edfdd94 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:05.617782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7e6c-13bf-4d99-9b1a-d6f73edfdd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:05.618063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff7e6c-13bf-4d99-9b1a-d6f73edfdd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:05.619931 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-67ff7e6c-13bf-4d99-9b1a-d6f73edfdd94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:05.633747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff7e6c-13bf-4d99-9b1a-d6f73edfdd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:05.635393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff7e6c-13bf-4d99-9b1a-d6f73edfdd94 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:05.651331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1136/2310] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:06:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:06:14.644251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=86 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:06:15.642430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=31 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:06:23.548012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363df70-61be-4695-8d3a-9914a85b09c7 service swift] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:23.609508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363df70-61be-4695-8d3a-9914a85b09c7 service swift] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:23.614150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:23.615067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:23.615376 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:23.615675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] PATH_INFO: `/v3/users/ac543734e22343939d28e18befbcda7d` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:23.616861 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac543734e22343939d28e18befbcda7d)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:23.619148 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:23.796163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac543734e22343939d28e18befbcda7d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:06:23.796750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac543734e22343939d28e18befbcda7d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:06:23.797355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac543734e22343939d28e18befbcda7d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:06:23.896693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac543734e22343939d28e18befbcda7d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:06:23.904240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac543734e22343939d28e18befbcda7d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:06:23.921600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1175/2311] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:06:23 2022] DELETE /identity/v3/users/ac543734e22343939d28e18befbcda7d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:06:23.926209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6aa36-c83c-4eb9-8cc2-b27203cf9b55 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:23.926721 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6aa36-c83c-4eb9-8cc2-b27203cf9b55 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:23.926825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6aa36-c83c-4eb9-8cc2-b27203cf9b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:23.944712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f1f6aa36-c83c-4eb9-8cc2-b27203cf9b55 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:06:23.946553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f1f6aa36-c83c-4eb9-8cc2-b27203cf9b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:24.005082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1137/2312] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:06:24.015225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:24.016649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:24.072810 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3df62d-849e-4cd3-9a00-2a1dff95a342 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:24.076362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6df446-2338-4820-b507-c61f3be68287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:24.076985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6df446-2338-4820-b507-c61f3be68287 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:24.077263 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6df446-2338-4820-b507-c61f3be68287 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:24.077532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6df446-2338-4820-b507-c61f3be68287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:24.086676 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6df446-2338-4820-b507-c61f3be68287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:24.088122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6df446-2338-4820-b507-c61f3be68287 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:24.097450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1176/2313] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:06:24.498638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6aa36-c83c-4eb9-8cc2-b27203cf9b55 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:24.500129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f1f6aa36-c83c-4eb9-8cc2-b27203cf9b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:24.515083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6aa36-c83c-4eb9-8cc2-b27203cf9b55 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:24.520796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:24.521643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:24.521939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:24.522208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] PATH_INFO: `/v3/projects/1fd1c490dc8d494491152dbfe1020633` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:24.524663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd1c490dc8d494491152dbfe1020633)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:24.526467 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:24.641438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd1c490dc8d494491152dbfe1020633', 'request_id': 'req-6f89ddc4-b913-43fd-98ac-69206ed99c4a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:06:24.647025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd1c490dc8d494491152dbfe1020633', 'request_id': 'req-6f89ddc4-b913-43fd-98ac-69206ed99c4a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:06:24.654045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd1c490dc8d494491152dbfe1020633', 'request_id': 'req-6f89ddc4-b913-43fd-98ac-69206ed99c4a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:06:24.736247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] The token cache is being invalidate because project 1fd1c490dc8d494491152dbfe1020633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:06:24.736534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:06:24.737156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-6f89ddc4-b913-43fd-98ac-69206ed99c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:06:24.738695 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1138/2314] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:06:24 2022] DELETE /identity/v3/projects/1fd1c490dc8d494491152dbfe1020633 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:06:24.744322 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f350d45-aa24-4af3-b417-568ea304d27a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:24.744840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f350d45-aa24-4af3-b417-568ea304d27a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:24.745002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f350d45-aa24-4af3-b417-568ea304d27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:24.763400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-5f350d45-aa24-4af3-b417-568ea304d27a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:06:24.764590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5f350d45-aa24-4af3-b417-568ea304d27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:24.781842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:06:24.824435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1177/2315] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:06:24.831890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08b974-e351-42cb-9d03-0fc2f400fde2 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:24.835757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08b974-e351-42cb-9d03-0fc2f400fde2 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:24.835757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08b974-e351-42cb-9d03-0fc2f400fde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:24.853144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-5d08b974-e351-42cb-9d03-0fc2f400fde2 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:06:24.854283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5d08b974-e351-42cb-9d03-0fc2f400fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:24.862464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1139/2316] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:06:24.867677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f350d45-aa24-4af3-b417-568ea304d27a None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:24.877250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f350d45-aa24-4af3-b417-568ea304d27a None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:24.881843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674165e-04fa-4368-97d3-4f55e94690a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:24.882488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674165e-04fa-4368-97d3-4f55e94690a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:24.882834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674165e-04fa-4368-97d3-4f55e94690a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:24.883326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674165e-04fa-4368-97d3-4f55e94690a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:24.884073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674165e-04fa-4368-97d3-4f55e94690a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:06:24.884379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674165e-04fa-4368-97d3-4f55e94690a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:24.885976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674165e-04fa-4368-97d3-4f55e94690a8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:24.898002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1178/2317] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:06:24.902314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08b974-e351-42cb-9d03-0fc2f400fde2 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:24.911752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08b974-e351-42cb-9d03-0fc2f400fde2 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:24.917331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b9c3-0cd1-47a0-a027-aec2d267495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:24.918022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b9c3-0cd1-47a0-a027-aec2d267495f admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:24.918306 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b9c3-0cd1-47a0-a027-aec2d267495f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:24.918581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8b9c3-0cd1-47a0-a027-aec2d267495f admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:24.919305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8b9c3-0cd1-47a0-a027-aec2d267495f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:24.921207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8b9c3-0cd1-47a0-a027-aec2d267495f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:25.048209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1140/2318] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:06:24 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:06:25.052392 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674165e-04fa-4368-97d3-4f55e94690a8 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:25.063198 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674165e-04fa-4368-97d3-4f55e94690a8 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:25.119649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a506731-f9b4-45e0-8cf6-d4859302822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:25.120263 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a506731-f9b4-45e0-8cf6-d4859302822a admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:25.120544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a506731-f9b4-45e0-8cf6-d4859302822a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:25.120814 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a506731-f9b4-45e0-8cf6-d4859302822a admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:25.121505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a506731-f9b4-45e0-8cf6-d4859302822a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:25.123443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a506731-f9b4-45e0-8cf6-d4859302822a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:25.229433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1179/2319] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:06:25 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:06:25.233489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b9c3-0cd1-47a0-a027-aec2d267495f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:25.244339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8b9c3-0cd1-47a0-a027-aec2d267495f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:25.249086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ad915-dd0a-49d8-9fd0-43bba2ab4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:25.249765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ad915-dd0a-49d8-9fd0-43bba2ab4086 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:25.250054 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ad915-dd0a-49d8-9fd0-43bba2ab4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:25.250360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ad915-dd0a-49d8-9fd0-43bba2ab4086 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:25.251124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ad915-dd0a-49d8-9fd0-43bba2ab4086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:25.252725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ad915-dd0a-49d8-9fd0-43bba2ab4086 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:25.263739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1141/2320] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:06:25.267878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a506731-f9b4-45e0-8cf6-d4859302822a admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:25.279228 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a506731-f9b4-45e0-8cf6-d4859302822a admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:25.284030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e34d3-906f-488e-9637-439419c6d7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:25.284739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e34d3-906f-488e-9637-439419c6d7df admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:25.285023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e34d3-906f-488e-9637-439419c6d7df admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:25.285298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e34d3-906f-488e-9637-439419c6d7df admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:25.286047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e34d3-906f-488e-9637-439419c6d7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:25.287677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e34d3-906f-488e-9637-439419c6d7df admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:25.300820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1180/2321] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:06:25.302863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ad915-dd0a-49d8-9fd0-43bba2ab4086 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:25.314026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ad915-dd0a-49d8-9fd0-43bba2ab4086 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:25.319097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fe558-b834-4ed0-9b25-e9e6e8a40d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:25.320066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fe558-b834-4ed0-9b25-e9e6e8a40d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:25.320508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fe558-b834-4ed0-9b25-e9e6e8a40d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:25.320857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fe558-b834-4ed0-9b25-e9e6e8a40d38 admin admin] PATH_INFO: `/v3/projects/14991816199b4ff1928a692ca95e7831/users/8d31dad379c24a7cae7bb53b85bd3e7f/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:25.338070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fe558-b834-4ed0-9b25-e9e6e8a40d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14991816199b4ff1928a692ca95e7831, user_id=8d31dad379c24a7cae7bb53b85bd3e7f, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:25.342002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fe558-b834-4ed0-9b25-e9e6e8a40d38 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:25.418653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1142/2322] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:06:25 2022] PUT /identity/v3/projects/14991816199b4ff1928a692ca95e7831/users/8d31dad379c24a7cae7bb53b85bd3e7f/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:06:25.423689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df442c46-cb9c-4c45-8160-3734b43a551c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:25.424003 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df442c46-cb9c-4c45-8160-3734b43a551c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:25.424281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df442c46-cb9c-4c45-8160-3734b43a551c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:25.442673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-df442c46-cb9c-4c45-8160-3734b43a551c None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:06:25.443925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-df442c46-cb9c-4c45-8160-3734b43a551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:25.505553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1181/2323] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:06:25.515932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fe558-b834-4ed0-9b25-e9e6e8a40d38 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:25.517764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-539fe558-b834-4ed0-9b25-e9e6e8a40d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:25.543353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:06:25.578749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fe558-b834-4ed0-9b25-e9e6e8a40d38 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:25.582745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354f32-b99a-41c8-8583-7e862c7d388c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:25.583408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354f32-b99a-41c8-8583-7e862c7d388c service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:25.583696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354f32-b99a-41c8-8583-7e862c7d388c service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:25.583976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb354f32-b99a-41c8-8583-7e862c7d388c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:25.593884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb354f32-b99a-41c8-8583-7e862c7d388c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:25.595368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb354f32-b99a-41c8-8583-7e862c7d388c service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:25.604977 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1143/2324] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:06:27.189959 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6772108-e914-4486-a4bc-499ddd8d97f5 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:27.190458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6772108-e914-4486-a4bc-499ddd8d97f5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:27.190553 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6772108-e914-4486-a4bc-499ddd8d97f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:27.217936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d6772108-e914-4486-a4bc-499ddd8d97f5 None None] MFA Rules not processed for user `8d31dad379c24a7cae7bb53b85bd3e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:06:27.220755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d6772108-e914-4486-a4bc-499ddd8d97f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:27.237435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:06:27.284808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1182/2325] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:06:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:06:27.296325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354f32-b99a-41c8-8583-7e862c7d388c service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:27.297722 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-cb354f32-b99a-41c8-8583-7e862c7d388c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:27.356835 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb354f32-b99a-41c8-8583-7e862c7d388c service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:27.360474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f7ab9-125d-42b2-bd62-2af4705f5799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:27.361125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f7ab9-125d-42b2-bd62-2af4705f5799 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:27.361412 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f7ab9-125d-42b2-bd62-2af4705f5799 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:27.361691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f7ab9-125d-42b2-bd62-2af4705f5799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:27.370942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f7ab9-125d-42b2-bd62-2af4705f5799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:27.372463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f7ab9-125d-42b2-bd62-2af4705f5799 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:27.381574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1144/2326] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:06:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:06:30.360848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475005c-83ce-484a-83b7-ea76bba349b5 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:30.361434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475005c-83ce-484a-83b7-ea76bba349b5 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:30.361434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475005c-83ce-484a-83b7-ea76bba349b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:30.379499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8475005c-83ce-484a-83b7-ea76bba349b5 None None] MFA Rules not processed for user `8d31dad379c24a7cae7bb53b85bd3e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:06:30.380734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8475005c-83ce-484a-83b7-ea76bba349b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:30.387783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1183/2327] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:06:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:06:30.617287 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f7ab9-125d-42b2-bd62-2af4705f5799 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:30.626609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f7ab9-125d-42b2-bd62-2af4705f5799 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:30.630207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d6d45-d484-4caf-9021-836cde515d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:30.630923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6d45-d484-4caf-9021-836cde515d9a service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:30.631226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6d45-d484-4caf-9021-836cde515d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:30.631520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d6d45-d484-4caf-9021-836cde515d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:30.633295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e95d6d45-d484-4caf-9021-836cde515d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:30.643171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d6d45-d484-4caf-9021-836cde515d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:30.644593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d6d45-d484-4caf-9021-836cde515d9a service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:30.653405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1145/2328] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:06:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:06:31.089475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475005c-83ce-484a-83b7-ea76bba349b5 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:31.090923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8475005c-83ce-484a-83b7-ea76bba349b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:31.163248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475005c-83ce-484a-83b7-ea76bba349b5 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:31.168235 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2318-fcff-46f6-992c-3dd15e435670 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:31.168922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2318-fcff-46f6-992c-3dd15e435670 service placement] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:31.169204 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2318-fcff-46f6-992c-3dd15e435670 service placement] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:31.169476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2318-fcff-46f6-992c-3dd15e435670 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:31.171226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c28c2318-fcff-46f6-992c-3dd15e435670 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:31.182995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c2318-fcff-46f6-992c-3dd15e435670 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:31.184570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c2318-fcff-46f6-992c-3dd15e435670 service placement] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:31.194435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1184/2329] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:06:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:06:34.724970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d6d45-d484-4caf-9021-836cde515d9a service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:34.733996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d6d45-d484-4caf-9021-836cde515d9a service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:34.737672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba330-8175-4aec-9d13-72dd5ceb695f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:34.745450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba330-8175-4aec-9d13-72dd5ceb695f service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:34.745450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba330-8175-4aec-9d13-72dd5ceb695f service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:34.745450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ba330-8175-4aec-9d13-72dd5ceb695f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:34.745450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a90ba330-8175-4aec-9d13-72dd5ceb695f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:34.750262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba330-8175-4aec-9d13-72dd5ceb695f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:34.751727 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ba330-8175-4aec-9d13-72dd5ceb695f service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:34.760227 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1146/2330] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:06:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:06:41.190212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=54 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:06:44.756108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=55 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:06:46.264495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2318-fcff-46f6-992c-3dd15e435670 service placement] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:06:46.266069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c28c2318-fcff-46f6-992c-3dd15e435670 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:46.345707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2318-fcff-46f6-992c-3dd15e435670 service placement] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:06:46.351271 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70af0-2dc2-46d7-8a86-d46df910cbb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:06:46.363999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70af0-2dc2-46d7-8a86-d46df910cbb5 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:06:46.363999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70af0-2dc2-46d7-8a86-d46df910cbb5 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:06:46.363999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70af0-2dc2-46d7-8a86-d46df910cbb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:06:46.363999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-52b70af0-2dc2-46d7-8a86-d46df910cbb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:06:46.412621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70af0-2dc2-46d7-8a86-d46df910cbb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:06:46.414189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70af0-2dc2-46d7-8a86-d46df910cbb5 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:06:46.423348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1185/2331] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:06:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:06:56.419118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=56 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:07:02.722692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba330-8175-4aec-9d13-72dd5ceb695f service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:07:02.736699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ba330-8175-4aec-9d13-72dd5ceb695f service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:07:02.742095 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d82c06-53d3-40cd-bdba-edc1a306faee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:07:02.742738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d82c06-53d3-40cd-bdba-edc1a306faee service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:07:02.743050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d82c06-53d3-40cd-bdba-edc1a306faee service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:07:02.743328 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d82c06-53d3-40cd-bdba-edc1a306faee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:07:02.745847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-35d82c06-53d3-40cd-bdba-edc1a306faee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:07:02.802854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d82c06-53d3-40cd-bdba-edc1a306faee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:07:02.804475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d82c06-53d3-40cd-bdba-edc1a306faee service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:07:02.814258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1147/2332] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:07:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:07:12.810009 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=28 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:07:18.658527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70af0-2dc2-46d7-8a86-d46df910cbb5 service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:07:18.660131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-52b70af0-2dc2-46d7-8a86-d46df910cbb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:07:18.679890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70af0-2dc2-46d7-8a86-d46df910cbb5 service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:07:18.680748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b28479-4a11-486b-a157-77be628447a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:07:18.681421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b28479-4a11-486b-a157-77be628447a5 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:07:18.681714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b28479-4a11-486b-a157-77be628447a5 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:07:18.681998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b28479-4a11-486b-a157-77be628447a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:07:18.684501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-22b28479-4a11-486b-a157-77be628447a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:07:18.697342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b28479-4a11-486b-a157-77be628447a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:07:18.699577 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b28479-4a11-486b-a157-77be628447a5 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:07:18.712166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1186/2333] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:07:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:07:23.316190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d82c06-53d3-40cd-bdba-edc1a306faee service nova] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:07:23.327804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d82c06-53d3-40cd-bdba-edc1a306faee service nova] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:07:23.333638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6936d8-4fb2-4930-a6ad-f6cc7ca9789d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:07:23.334607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6936d8-4fb2-4930-a6ad-f6cc7ca9789d service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:07:23.334959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6936d8-4fb2-4930-a6ad-f6cc7ca9789d service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:07:23.335407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6936d8-4fb2-4930-a6ad-f6cc7ca9789d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:07:23.337268 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8a6936d8-4fb2-4930-a6ad-f6cc7ca9789d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:07:23.399114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6936d8-4fb2-4930-a6ad-f6cc7ca9789d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:07:23.401583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6936d8-4fb2-4930-a6ad-f6cc7ca9789d service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:07:23.411648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1148/2334] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:07:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:07:23.756217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81ac0c-7187-4af5-a300-22d240510ba8 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:07:23.756701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81ac0c-7187-4af5-a300-22d240510ba8 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:07:23.756701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81ac0c-7187-4af5-a300-22d240510ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:07:23.776984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7d81ac0c-7187-4af5-a300-22d240510ba8 None None] MFA Rules not processed for user `2e7ba82a80834a4aa098e9604165cfad`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:07:23.778275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7d81ac0c-7187-4af5-a300-22d240510ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:07:23.785585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1187/2335] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:07:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:07:33.406723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=28 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:07:33.770885 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=9 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:07:41.763361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6936d8-4fb2-4930-a6ad-f6cc7ca9789d service nova] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:07:41.774987 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6936d8-4fb2-4930-a6ad-f6cc7ca9789d service nova] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:07:41.780767 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8a96c-a919-4c81-89f9-0b5689459af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:07:41.781524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a96c-a919-4c81-89f9-0b5689459af1 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:07:41.781688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a96c-a919-4c81-89f9-0b5689459af1 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:07:41.781972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8a96c-a919-4c81-89f9-0b5689459af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:07:41.783764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3bb8a96c-a919-4c81-89f9-0b5689459af1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:07:41.797285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8a96c-a919-4c81-89f9-0b5689459af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:07:41.798954 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8a96c-a919-4c81-89f9-0b5689459af1 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:07:41.810426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1149/2336] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:07:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:07:45.555141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6dc7-c39e-4299-8f32-24d8a59336e9 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:07:45.555722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6dc7-c39e-4299-8f32-24d8a59336e9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:07:45.555983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6dc7-c39e-4299-8f32-24d8a59336e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:07:45.576146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-fa7d6dc7-c39e-4299-8f32-24d8a59336e9 None None] MFA Rules not processed for user `94954697f2ba4d94bf0b7d55c4c1beb1`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:07:45.577350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-fa7d6dc7-c39e-4299-8f32-24d8a59336e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:07:45.634032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1188/2337] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:07:50.956506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89bcb1-9a1f-44d6-b2bd-b1e8b763681c None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:07:50.957207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89bcb1-9a1f-44d6-b2bd-b1e8b763681c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:07:50.957207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89bcb1-9a1f-44d6-b2bd-b1e8b763681c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:07:50.983286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-5a89bcb1-9a1f-44d6-b2bd-b1e8b763681c None None] MFA Rules not processed for user `7caf8c01365b4918abf24203b7a14dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:07:50.984787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5a89bcb1-9a1f-44d6-b2bd-b1e8b763681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:07:50.992548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1150/2338] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:07:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:07:51.301017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d6dc7-c39e-4299-8f32-24d8a59336e9 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:07:51.302772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-fa7d6dc7-c39e-4299-8f32-24d8a59336e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:07:51.314773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d6dc7-c39e-4299-8f32-24d8a59336e9 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:07:51.318369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8006b0-a824-477d-b8b6-9358ac5d6143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:07:51.319146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8006b0-a824-477d-b8b6-9358ac5d6143 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:07:51.319435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8006b0-a824-477d-b8b6-9358ac5d6143 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:07:51.319713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8006b0-a824-477d-b8b6-9358ac5d6143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:07:51.321443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ad8006b0-a824-477d-b8b6-9358ac5d6143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:07:51.331132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8006b0-a824-477d-b8b6-9358ac5d6143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:07:51.341071 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8006b0-a824-477d-b8b6-9358ac5d6143 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:07:51.341833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1189/2339] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:07:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:08:00.974117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=9 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:08:01.337383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=31 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:08:11.212332 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6175-98ee-4f2d-a042-6c3d3db81cd8 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:08:11.212878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6175-98ee-4f2d-a042-6c3d3db81cd8 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:08:11.212878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c6175-98ee-4f2d-a042-6c3d3db81cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:08:11.232548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ef7c6175-98ee-4f2d-a042-6c3d3db81cd8 None None] MFA Rules not processed for user `8d31dad379c24a7cae7bb53b85bd3e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:08:11.236332 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ef7c6175-98ee-4f2d-a042-6c3d3db81cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:08:11.243580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1151/2340] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:08:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:08:17.402784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8006b0-a824-477d-b8b6-9358ac5d6143 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:08:17.425540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8006b0-a824-477d-b8b6-9358ac5d6143 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:08:17.431791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9d084-f1aa-46b8-b1f2-56f83295492d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:08:17.439485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9d084-f1aa-46b8-b1f2-56f83295492d service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:08:17.439485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9d084-f1aa-46b8-b1f2-56f83295492d service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:08:17.439485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9d084-f1aa-46b8-b1f2-56f83295492d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:08:17.439485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c9f9d084-f1aa-46b8-b1f2-56f83295492d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:08:17.448214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9d084-f1aa-46b8-b1f2-56f83295492d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:08:17.449842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9d084-f1aa-46b8-b1f2-56f83295492d service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:08:17.462357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1190/2341] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:08:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:08:21.226442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:08:27.456401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=6 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:08:55.995349 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831f04-7fff-4d01-80d8-718cb35fd97c None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:08:55.996339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831f04-7fff-4d01-80d8-718cb35fd97c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:08:55.996847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831f04-7fff-4d01-80d8-718cb35fd97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:08:56.018131 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-69831f04-7fff-4d01-80d8-718cb35fd97c None None] MFA Rules not processed for user `f77a4ee31a9e48d18a3be08267eb6236`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:08:56.019367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-69831f04-7fff-4d01-80d8-718cb35fd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:08:56.030493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1152/2342] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:08:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:09:06.011485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:09:22.631349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9d084-f1aa-46b8-b1f2-56f83295492d service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:22.632756 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c9f9d084-f1aa-46b8-b1f2-56f83295492d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:22.644134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9d084-f1aa-46b8-b1f2-56f83295492d service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:22.647802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5db2-f68b-4fa1-92fb-787a8d60129a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:22.652659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5db2-f68b-4fa1-92fb-787a8d60129a service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:22.652659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5db2-f68b-4fa1-92fb-787a8d60129a service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:22.652659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde5db2-f68b-4fa1-92fb-787a8d60129a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:22.652659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8bde5db2-f68b-4fa1-92fb-787a8d60129a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:22.662260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde5db2-f68b-4fa1-92fb-787a8d60129a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:22.663619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde5db2-f68b-4fa1-92fb-787a8d60129a service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:22.675482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1191/2343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:09:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:09:31.560913 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69831f04-7fff-4d01-80d8-718cb35fd97c None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:31.562360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-69831f04-7fff-4d01-80d8-718cb35fd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:31.577667 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69831f04-7fff-4d01-80d8-718cb35fd97c None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:31.582571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4bf16-7570-4437-8dbb-5096b1647d18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:31.583264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4bf16-7570-4437-8dbb-5096b1647d18 service placement] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:31.583551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4bf16-7570-4437-8dbb-5096b1647d18 service placement] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:31.583825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4bf16-7570-4437-8dbb-5096b1647d18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:31.586718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a3b4bf16-7570-4437-8dbb-5096b1647d18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:31.601064 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4bf16-7570-4437-8dbb-5096b1647d18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:31.602933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4bf16-7570-4437-8dbb-5096b1647d18 service placement] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:31.614423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1153/2344] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:09:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:09:32.670862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=6 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:09:34.229497 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5db2-f68b-4fa1-92fb-787a8d60129a service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:34.243205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde5db2-f68b-4fa1-92fb-787a8d60129a service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:34.248263 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca43f9-b0b6-4dac-8070-183f20a9a3ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:34.248929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca43f9-b0b6-4dac-8070-183f20a9a3ff service placement] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:34.249383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca43f9-b0b6-4dac-8070-183f20a9a3ff service placement] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:34.249661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca43f9-b0b6-4dac-8070-183f20a9a3ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:34.251457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-deca43f9-b0b6-4dac-8070-183f20a9a3ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:34.264479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca43f9-b0b6-4dac-8070-183f20a9a3ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:34.266338 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca43f9-b0b6-4dac-8070-183f20a9a3ff service placement] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:34.277914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1192/2345] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:09:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:09:34.350897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4bf16-7570-4437-8dbb-5096b1647d18 service placement] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:34.362832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4bf16-7570-4437-8dbb-5096b1647d18 service placement] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:34.367625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:34.368519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:34.368801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:34.369077 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] PATH_INFO: `/v3/users/8d31dad379c24a7cae7bb53b85bd3e7f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:34.370289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d31dad379c24a7cae7bb53b85bd3e7f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:34.372239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:34.577877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d31dad379c24a7cae7bb53b85bd3e7f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:34.578532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d31dad379c24a7cae7bb53b85bd3e7f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:34.579165 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d31dad379c24a7cae7bb53b85bd3e7f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:34.586339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d31dad379c24a7cae7bb53b85bd3e7f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:34.597749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d31dad379c24a7cae7bb53b85bd3e7f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:34.724055 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1154/2346] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:09:34 2022] DELETE /identity/v3/users/8d31dad379c24a7cae7bb53b85bd3e7f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:09:34.994781 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca43f9-b0b6-4dac-8070-183f20a9a3ff service placement] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:35.006074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca43f9-b0b6-4dac-8070-183f20a9a3ff service placement] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:35.071848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:35.072710 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:35.072993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:35.073266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] PATH_INFO: `/v3/projects/14991816199b4ff1928a692ca95e7831` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:35.074442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14991816199b4ff1928a692ca95e7831)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:35.076442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:35.175914 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14991816199b4ff1928a692ca95e7831', 'request_id': 'req-0d7f149e-9f8d-42aa-85d0-1312213192c2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:35.182283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14991816199b4ff1928a692ca95e7831', 'request_id': 'req-0d7f149e-9f8d-42aa-85d0-1312213192c2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:35.188452 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14991816199b4ff1928a692ca95e7831', 'request_id': 'req-0d7f149e-9f8d-42aa-85d0-1312213192c2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:35.307188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] The token cache is being invalidate because project 14991816199b4ff1928a692ca95e7831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:09:35.307925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:35.308094 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:35.309700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1193/2347] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:09:34 2022] DELETE /identity/v3/projects/14991816199b4ff1928a692ca95e7831 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:09:44.213025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:44.214479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:44.273364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba894f7-49e1-450c-b4d2-c58e1975c12f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:44.320752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cfd06-5169-415e-a313-ed7187e02ccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:44.321395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cfd06-5169-415e-a313-ed7187e02ccd service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:44.321676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cfd06-5169-415e-a313-ed7187e02ccd service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:44.321952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cfd06-5169-415e-a313-ed7187e02ccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:44.323692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9a8cfd06-5169-415e-a313-ed7187e02ccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:44.355978 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:09:44.387724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cfd06-5169-415e-a313-ed7187e02ccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:44.389170 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cfd06-5169-415e-a313-ed7187e02ccd service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:44.399482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1155/2348] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:09:45.303673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:09:48.179800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:48.181533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:48.195361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f149e-9f8d-42aa-85d0-1312213192c2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:48.199998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:48.200892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:48.201343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:48.201671 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] PATH_INFO: `/v3/users/94954697f2ba4d94bf0b7d55c4c1beb1` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:48.202904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94954697f2ba4d94bf0b7d55c4c1beb1)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:48.205054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:48.611836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94954697f2ba4d94bf0b7d55c4c1beb1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:48.612498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94954697f2ba4d94bf0b7d55c4c1beb1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:48.613101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94954697f2ba4d94bf0b7d55c4c1beb1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:48.710740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94954697f2ba4d94bf0b7d55c4c1beb1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:48.718688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-79b997a8-c843-416d-aa6b-d796592c0c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94954697f2ba4d94bf0b7d55c4c1beb1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:48.737047 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1194/2349] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:09:48 2022] DELETE /identity/v3/users/94954697f2ba4d94bf0b7d55c4c1beb1 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:09:49.005203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cfd06-5169-415e-a313-ed7187e02ccd service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:49.015585 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cfd06-5169-415e-a313-ed7187e02ccd service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:49.076575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:49.077428 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:49.077706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:49.077980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] PATH_INFO: `/v3/projects/c76c3b88e1af4015842d58e3bec92075` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:49.079355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76c3b88e1af4015842d58e3bec92075)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:49.081262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:49.232163 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76c3b88e1af4015842d58e3bec92075', 'request_id': 'req-28977231-81ef-4e1f-919b-0cb0881f3ad0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:49.237620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76c3b88e1af4015842d58e3bec92075', 'request_id': 'req-28977231-81ef-4e1f-919b-0cb0881f3ad0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:49.243963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76c3b88e1af4015842d58e3bec92075', 'request_id': 'req-28977231-81ef-4e1f-919b-0cb0881f3ad0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:49.357461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] The token cache is being invalidate because project c76c3b88e1af4015842d58e3bec92075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:09:49.357667 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:49.358286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-28977231-81ef-4e1f-919b-0cb0881f3ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:09:49.359885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1156/2350] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:09:49 2022] DELETE /identity/v3/projects/c76c3b88e1af4015842d58e3bec92075 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:09:49.364852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b3f68-476b-4e73-bcf2-bb2dc693fcc0 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:49.368836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b3f68-476b-4e73-bcf2-bb2dc693fcc0 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:49.368836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b3f68-476b-4e73-bcf2-bb2dc693fcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:49.384369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-101b3f68-476b-4e73-bcf2-bb2dc693fcc0 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:09:49.385528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-101b3f68-476b-4e73-bcf2-bb2dc693fcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:49.452011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1195/2351] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:09:49.460183 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21cb02-b72a-4f40-bdbc-3d4f57b1a229 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:49.460526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21cb02-b72a-4f40-bdbc-3d4f57b1a229 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:49.460806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21cb02-b72a-4f40-bdbc-3d4f57b1a229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:49.481771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ea21cb02-b72a-4f40-bdbc-3d4f57b1a229 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:09:49.483044 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ea21cb02-b72a-4f40-bdbc-3d4f57b1a229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:49.490876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1157/2352] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:09:49.495233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b3f68-476b-4e73-bcf2-bb2dc693fcc0 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:49.504774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b3f68-476b-4e73-bcf2-bb2dc693fcc0 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:49.509989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4a97c-1b11-4f5d-9ef8-e6a90649a587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:49.510635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4a97c-1b11-4f5d-9ef8-e6a90649a587 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:49.510921 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4a97c-1b11-4f5d-9ef8-e6a90649a587 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:49.511352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf4a97c-1b11-4f5d-9ef8-e6a90649a587 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:49.512072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4a97c-1b11-4f5d-9ef8-e6a90649a587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:09:49.512377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4a97c-1b11-4f5d-9ef8-e6a90649a587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:49.513965 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf4a97c-1b11-4f5d-9ef8-e6a90649a587 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:49.526069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1196/2353] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:09:49.530193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21cb02-b72a-4f40-bdbc-3d4f57b1a229 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:49.539593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21cb02-b72a-4f40-bdbc-3d4f57b1a229 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:49.544389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf2ac4-ff7c-4307-8a09-8f5ff011a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:49.545038 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf2ac4-ff7c-4307-8a09-8f5ff011a837 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:49.545341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf2ac4-ff7c-4307-8a09-8f5ff011a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:49.545608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf2ac4-ff7c-4307-8a09-8f5ff011a837 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:49.546299 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf2ac4-ff7c-4307-8a09-8f5ff011a837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:49.548241 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf2ac4-ff7c-4307-8a09-8f5ff011a837 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:49.840158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1158/2354] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:09:49 2022] POST /identity/v3/projects => generated 385 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:09:49.844529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4a97c-1b11-4f5d-9ef8-e6a90649a587 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:49.854572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf4a97c-1b11-4f5d-9ef8-e6a90649a587 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:49.909471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ad3b9-698e-4aaa-8c98-63739d4babfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:49.910112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ad3b9-698e-4aaa-8c98-63739d4babfe admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:49.910389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ad3b9-698e-4aaa-8c98-63739d4babfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:49.910661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ad3b9-698e-4aaa-8c98-63739d4babfe admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:49.911386 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ad3b9-698e-4aaa-8c98-63739d4babfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:49.913803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ad3b9-698e-4aaa-8c98-63739d4babfe admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:49.920393 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:09:50.032834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1197/2355] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:09:49 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:09:50.036100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf2ac4-ff7c-4307-8a09-8f5ff011a837 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:50.047305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf2ac4-ff7c-4307-8a09-8f5ff011a837 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:50.051970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2699bc-049f-4fed-b8e8-54a061760111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:50.052626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2699bc-049f-4fed-b8e8-54a061760111 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:50.053694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2699bc-049f-4fed-b8e8-54a061760111 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:50.053974 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2699bc-049f-4fed-b8e8-54a061760111 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:50.054718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2699bc-049f-4fed-b8e8-54a061760111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:50.056338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2699bc-049f-4fed-b8e8-54a061760111 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:50.066264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1159/2356] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:09:50.070442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ad3b9-698e-4aaa-8c98-63739d4babfe admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:50.080404 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ad3b9-698e-4aaa-8c98-63739d4babfe admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:50.085469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8148d-503b-456f-8697-9d7ce5c520f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:50.086391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8148d-503b-456f-8697-9d7ce5c520f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:50.086675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8148d-503b-456f-8697-9d7ce5c520f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:50.086954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8148d-503b-456f-8697-9d7ce5c520f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:50.088525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8148d-503b-456f-8697-9d7ce5c520f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:50.089410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8148d-503b-456f-8697-9d7ce5c520f5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:50.101004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1198/2357] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:09:50.105065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2699bc-049f-4fed-b8e8-54a061760111 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:50.114931 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2699bc-049f-4fed-b8e8-54a061760111 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:50.120449 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61ba6a-bde7-4419-8028-11e5ff33a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:50.121325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ba6a-bde7-4419-8028-11e5ff33a9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:50.121612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ba6a-bde7-4419-8028-11e5ff33a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:50.121890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61ba6a-bde7-4419-8028-11e5ff33a9f4 admin admin] PATH_INFO: `/v3/projects/629718bd9e544cf0a8e76aa5a91322e5/users/61c9a050931d414db1f30b906fce0833/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:50.124205 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:09:50.137150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61ba6a-bde7-4419-8028-11e5ff33a9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629718bd9e544cf0a8e76aa5a91322e5, user_id=61c9a050931d414db1f30b906fce0833, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:50.139896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61ba6a-bde7-4419-8028-11e5ff33a9f4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:50.220498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1160/2358] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:09:50 2022] PUT /identity/v3/projects/629718bd9e544cf0a8e76aa5a91322e5/users/61c9a050931d414db1f30b906fce0833/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:09:50.232184 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb90804-956f-4cd0-86ab-892233d11a11 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:50.232475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb90804-956f-4cd0-86ab-892233d11a11 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:50.232754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb90804-956f-4cd0-86ab-892233d11a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:50.259749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3fb90804-956f-4cd0-86ab-892233d11a11 None None] MFA Rules not processed for user `61c9a050931d414db1f30b906fce0833`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:09:50.260995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3fb90804-956f-4cd0-86ab-892233d11a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:50.325443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1199/2359] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:09:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:09:50.340912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61ba6a-bde7-4419-8028-11e5ff33a9f4 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:09:50.342649 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fb61ba6a-bde7-4419-8028-11e5ff33a9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:09:50.416655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61ba6a-bde7-4419-8028-11e5ff33a9f4 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:09:50.422232 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f4c30-f22d-4adb-89ab-71822a33e368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:09:50.422874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f4c30-f22d-4adb-89ab-71822a33e368 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:09:50.423182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f4c30-f22d-4adb-89ab-71822a33e368 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:09:50.423479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f4c30-f22d-4adb-89ab-71822a33e368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:09:50.431537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f4c30-f22d-4adb-89ab-71822a33e368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:09:50.433114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f4c30-f22d-4adb-89ab-71822a33e368 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:09:50.442026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1161/2360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:09:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:00.322395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:00.438389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:00.923448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb90804-956f-4cd0-86ab-892233d11a11 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:00.988193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb90804-956f-4cd0-86ab-892233d11a11 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:00.995621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:00.996618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:00.996972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:00.997336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] PATH_INFO: `/v3/users/61c9a050931d414db1f30b906fce0833` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:00.998623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c9a050931d414db1f30b906fce0833)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:01.000713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:01.365989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c9a050931d414db1f30b906fce0833'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:01.366650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c9a050931d414db1f30b906fce0833'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:01.367330 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c9a050931d414db1f30b906fce0833'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:01.471946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c9a050931d414db1f30b906fce0833'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:01.479303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c9a050931d414db1f30b906fce0833'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:01.496239 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1200/2361] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:10:00 2022] DELETE /identity/v3/users/61c9a050931d414db1f30b906fce0833 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:01.500764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a8875-e890-46fa-acc7-e0ccafa4cbf8 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:01.501248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a8875-e890-46fa-acc7-e0ccafa4cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:01.501365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a8875-e890-46fa-acc7-e0ccafa4cbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:01.518701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-155a8875-e890-46fa-acc7-e0ccafa4cbf8 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:01.520118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-155a8875-e890-46fa-acc7-e0ccafa4cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:01.578811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1162/2362] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:01.588662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:01.590097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:01.647035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeaa650-8d22-47c2-803b-c309f817415d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:01.651259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a6da1-0b23-4903-bf08-4748dbf6fa0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:01.652021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a6da1-0b23-4903-bf08-4748dbf6fa0f service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:01.652307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a6da1-0b23-4903-bf08-4748dbf6fa0f service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:01.652581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a6da1-0b23-4903-bf08-4748dbf6fa0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:01.661908 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a6da1-0b23-4903-bf08-4748dbf6fa0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:01.664054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a6da1-0b23-4903-bf08-4748dbf6fa0f service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:01.673589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1201/2363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:02.136659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a8875-e890-46fa-acc7-e0ccafa4cbf8 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:02.140304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-155a8875-e890-46fa-acc7-e0ccafa4cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:02.152265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a8875-e890-46fa-acc7-e0ccafa4cbf8 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:02.157216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:02.158090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:02.158371 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:02.158644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] PATH_INFO: `/v3/projects/629718bd9e544cf0a8e76aa5a91322e5` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:02.160611 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629718bd9e544cf0a8e76aa5a91322e5)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:02.162601 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:02.308488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629718bd9e544cf0a8e76aa5a91322e5', 'request_id': 'req-b961d570-d231-4e7d-a30a-28a9ae770593'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:02.314001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629718bd9e544cf0a8e76aa5a91322e5', 'request_id': 'req-b961d570-d231-4e7d-a30a-28a9ae770593'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:02.320902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629718bd9e544cf0a8e76aa5a91322e5', 'request_id': 'req-b961d570-d231-4e7d-a30a-28a9ae770593'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:02.413769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] The token cache is being invalidate because project 629718bd9e544cf0a8e76aa5a91322e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:10:02.414050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:02.414671 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b961d570-d231-4e7d-a30a-28a9ae770593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:02.416244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1163/2364] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:10:02 2022] DELETE /identity/v3/projects/629718bd9e544cf0a8e76aa5a91322e5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:02.423895 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5e764-16ea-4cc8-8dde-8348e67cca96 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:02.423895 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5e764-16ea-4cc8-8dde-8348e67cca96 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:02.423895 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5e764-16ea-4cc8-8dde-8348e67cca96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:02.440275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d5f5e764-16ea-4cc8-8dde-8348e67cca96 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:02.441482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d5f5e764-16ea-4cc8-8dde-8348e67cca96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:02.462939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:02.502368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1202/2365] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:02.510683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2cec-feef-48b1-aec5-ebc155306a3f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:02.511203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2cec-feef-48b1-aec5-ebc155306a3f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:02.511319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd2cec-feef-48b1-aec5-ebc155306a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:02.530585 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3efd2cec-feef-48b1-aec5-ebc155306a3f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:02.531830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3efd2cec-feef-48b1-aec5-ebc155306a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:02.541012 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1164/2366] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:02.545205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5e764-16ea-4cc8-8dde-8348e67cca96 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:02.555281 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5e764-16ea-4cc8-8dde-8348e67cca96 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:02.561349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2a099-b381-485d-8ce1-39a0a8bd2327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:02.561349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2a099-b381-485d-8ce1-39a0a8bd2327 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:02.561349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2a099-b381-485d-8ce1-39a0a8bd2327 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:02.561349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2a099-b381-485d-8ce1-39a0a8bd2327 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:02.561867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2a099-b381-485d-8ce1-39a0a8bd2327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:10:02.562175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2a099-b381-485d-8ce1-39a0a8bd2327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:02.563828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2a099-b381-485d-8ce1-39a0a8bd2327 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:02.575609 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1203/2367] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:10:02.579731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd2cec-feef-48b1-aec5-ebc155306a3f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:02.589825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd2cec-feef-48b1-aec5-ebc155306a3f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:02.594464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2584b-8115-455c-bd5b-e9ac11b9a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:02.595154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2584b-8115-455c-bd5b-e9ac11b9a419 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:02.595438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2584b-8115-455c-bd5b-e9ac11b9a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:02.595712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2584b-8115-455c-bd5b-e9ac11b9a419 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:02.596424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2584b-8115-455c-bd5b-e9ac11b9a419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:02.598292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2584b-8115-455c-bd5b-e9ac11b9a419 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:02.709279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1165/2368] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:10:02 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:10:02.710687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2a099-b381-485d-8ce1-39a0a8bd2327 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:02.721549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2a099-b381-485d-8ce1-39a0a8bd2327 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:02.780419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd4fef-f586-40ee-8a22-084366207135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:02.781084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd4fef-f586-40ee-8a22-084366207135 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:02.781390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd4fef-f586-40ee-8a22-084366207135 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:02.781667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd4fef-f586-40ee-8a22-084366207135 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:02.782353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd4fef-f586-40ee-8a22-084366207135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:02.784290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd4fef-f586-40ee-8a22-084366207135 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:02.969749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1204/2369] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:10:02 2022] POST /identity/v3/users => generated 282 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:10:02.973995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2584b-8115-455c-bd5b-e9ac11b9a419 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:02.984742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2584b-8115-455c-bd5b-e9ac11b9a419 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:02.989534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d63452-3754-48ea-b34b-b755eb188695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:02.990189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d63452-3754-48ea-b34b-b755eb188695 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:02.990470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d63452-3754-48ea-b34b-b755eb188695 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:02.990742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d63452-3754-48ea-b34b-b755eb188695 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:02.991575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d63452-3754-48ea-b34b-b755eb188695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:02.993166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d63452-3754-48ea-b34b-b755eb188695 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:03.004193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1166/2370] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:10:03.008337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd4fef-f586-40ee-8a22-084366207135 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:03.018334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd4fef-f586-40ee-8a22-084366207135 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:03.023771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fab7ff-ea70-47b6-a081-bd2e48e6cdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:03.024426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fab7ff-ea70-47b6-a081-bd2e48e6cdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:03.024817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fab7ff-ea70-47b6-a081-bd2e48e6cdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:03.025097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fab7ff-ea70-47b6-a081-bd2e48e6cdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:03.025824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fab7ff-ea70-47b6-a081-bd2e48e6cdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:03.027454 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fab7ff-ea70-47b6-a081-bd2e48e6cdb6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:03.037560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1205/2371] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:10:03.042949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d63452-3754-48ea-b34b-b755eb188695 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:03.052863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d63452-3754-48ea-b34b-b755eb188695 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:03.057526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115c21-7dcf-48d5-9ec3-438f8084ca82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:03.058394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115c21-7dcf-48d5-9ec3-438f8084ca82 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:03.058676 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115c21-7dcf-48d5-9ec3-438f8084ca82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:03.058984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00115c21-7dcf-48d5-9ec3-438f8084ca82 admin admin] PATH_INFO: `/v3/projects/df2d2b462ebd4c5897bce1bcc540ef9d/users/571b1178b18f4252a97a74b1ccd76df8/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:03.074242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00115c21-7dcf-48d5-9ec3-438f8084ca82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2d2b462ebd4c5897bce1bcc540ef9d, user_id=571b1178b18f4252a97a74b1ccd76df8, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:03.076917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00115c21-7dcf-48d5-9ec3-438f8084ca82 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:03.170234 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1167/2372] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:10:03 2022] PUT /identity/v3/projects/df2d2b462ebd4c5897bce1bcc540ef9d/users/571b1178b18f4252a97a74b1ccd76df8/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:03.181325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97c3e-7f67-4ed0-9084-fcb5ff2713af None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:03.181620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97c3e-7f67-4ed0-9084-fcb5ff2713af None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:03.181924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da97c3e-7f67-4ed0-9084-fcb5ff2713af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:03.208450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-6da97c3e-7f67-4ed0-9084-fcb5ff2713af None None] MFA Rules not processed for user `571b1178b18f4252a97a74b1ccd76df8`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:03.209670 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6da97c3e-7f67-4ed0-9084-fcb5ff2713af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:03.276773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1206/2373] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:03.281213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115c21-7dcf-48d5-9ec3-438f8084ca82 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:03.305549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:03.348966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00115c21-7dcf-48d5-9ec3-438f8084ca82 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:03.353981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c7afb-caac-45bb-83b9-de592f701e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:03.354648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c7afb-caac-45bb-83b9-de592f701e23 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:03.354956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c7afb-caac-45bb-83b9-de592f701e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:03.355341 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c7afb-caac-45bb-83b9-de592f701e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:03.356045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c7afb-caac-45bb-83b9-de592f701e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:03.358035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c7afb-caac-45bb-83b9-de592f701e23 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:03.736489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1168/2374] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:10:03 2022] POST /identity/v3/projects => generated 365 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:10:03.740591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da97c3e-7f67-4ed0-9084-fcb5ff2713af None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:03.752585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da97c3e-7f67-4ed0-9084-fcb5ff2713af None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:03.768113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:03.813529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aacdd2-1490-4ca2-91ca-369a8c3c535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:03.814133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aacdd2-1490-4ca2-91ca-369a8c3c535c admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:03.814413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aacdd2-1490-4ca2-91ca-369a8c3c535c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:03.814685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aacdd2-1490-4ca2-91ca-369a8c3c535c admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:03.815426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aacdd2-1490-4ca2-91ca-369a8c3c535c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:03.817363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aacdd2-1490-4ca2-91ca-369a8c3c535c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:03.895122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1207/2375] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:10:03 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:10:03.899700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c7afb-caac-45bb-83b9-de592f701e23 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:03.909977 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c7afb-caac-45bb-83b9-de592f701e23 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:03.915587 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aaa99-cd62-4d9e-81de-cc263adc38ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:03.916340 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aaa99-cd62-4d9e-81de-cc263adc38ac admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:03.916628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aaa99-cd62-4d9e-81de-cc263adc38ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:03.916909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aaa99-cd62-4d9e-81de-cc263adc38ac admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:03.917640 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6aaa99-cd62-4d9e-81de-cc263adc38ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:03.919279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6aaa99-cd62-4d9e-81de-cc263adc38ac admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:03.930134 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1169/2376] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:10:03.935754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aacdd2-1490-4ca2-91ca-369a8c3c535c admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:03.946487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aacdd2-1490-4ca2-91ca-369a8c3c535c admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:03.951153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52506738-fd59-443b-b664-ad0ff319dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:03.952046 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52506738-fd59-443b-b664-ad0ff319dd50 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:03.952623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52506738-fd59-443b-b664-ad0ff319dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:03.952623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52506738-fd59-443b-b664-ad0ff319dd50 admin admin] PATH_INFO: `/v3/projects/375c6d38442d40e484907d64a1bcf2bc/users/55e7240fde174656b5085450dd0c99a1/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:03.968173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52506738-fd59-443b-b664-ad0ff319dd50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=375c6d38442d40e484907d64a1bcf2bc, user_id=55e7240fde174656b5085450dd0c99a1, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:03.970817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52506738-fd59-443b-b664-ad0ff319dd50 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:04.061429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1208/2377] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:10:03 2022] PUT /identity/v3/projects/375c6d38442d40e484907d64a1bcf2bc/users/55e7240fde174656b5085450dd0c99a1/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:04.065332 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aaa99-cd62-4d9e-81de-cc263adc38ac admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:04.076437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aaa99-cd62-4d9e-81de-cc263adc38ac admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:04.135596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7d647-fc70-49b5-876f-5f29b2029b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:04.136267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7d647-fc70-49b5-876f-5f29b2029b71 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:04.136546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7d647-fc70-49b5-876f-5f29b2029b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:04.136817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7d647-fc70-49b5-876f-5f29b2029b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:04.137569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7d647-fc70-49b5-876f-5f29b2029b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:04.139212 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7d647-fc70-49b5-876f-5f29b2029b71 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:04.149493 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1170/2378] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:10:04.153710 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52506738-fd59-443b-b664-ad0ff319dd50 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:04.165512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52506738-fd59-443b-b664-ad0ff319dd50 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:04.169849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2148dd-d472-4f7c-aef0-7d22159ace38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:04.170722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2148dd-d472-4f7c-aef0-7d22159ace38 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:04.171031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2148dd-d472-4f7c-aef0-7d22159ace38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:04.171312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2148dd-d472-4f7c-aef0-7d22159ace38 admin admin] PATH_INFO: `/v3/projects/375c6d38442d40e484907d64a1bcf2bc/users/55e7240fde174656b5085450dd0c99a1/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:04.173277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2148dd-d472-4f7c-aef0-7d22159ace38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=375c6d38442d40e484907d64a1bcf2bc, user_id=55e7240fde174656b5085450dd0c99a1, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:04.175975 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2148dd-d472-4f7c-aef0-7d22159ace38 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:04.187257 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1209/2379] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:10:04 2022] PUT /identity/v3/projects/375c6d38442d40e484907d64a1bcf2bc/users/55e7240fde174656b5085450dd0c99a1/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:04.197908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a0c4-505b-4906-9026-a6b97f21759b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:04.198202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a0c4-505b-4906-9026-a6b97f21759b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:04.198486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a0c4-505b-4906-9026-a6b97f21759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:04.225944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-2c25a0c4-505b-4906-9026-a6b97f21759b None None] MFA Rules not processed for user `55e7240fde174656b5085450dd0c99a1`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:04.227475 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2c25a0c4-505b-4906-9026-a6b97f21759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:04.297186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1171/2380] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:04.309532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2148dd-d472-4f7c-aef0-7d22159ace38 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:04.311266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4b2148dd-d472-4f7c-aef0-7d22159ace38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:04.369266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2148dd-d472-4f7c-aef0-7d22159ace38 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:04.376009 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25683573-0db6-44ed-ae12-c534579fb027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:04.376650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683573-0db6-44ed-ae12-c534579fb027 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:04.376930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683573-0db6-44ed-ae12-c534579fb027 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:04.377205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25683573-0db6-44ed-ae12-c534579fb027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:04.386961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25683573-0db6-44ed-ae12-c534579fb027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:04.388399 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25683573-0db6-44ed-ae12-c534579fb027 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:04.398358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1210/2381] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:04.633474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25a0c4-505b-4906-9026-a6b97f21759b None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:04.642933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25a0c4-505b-4906-9026-a6b97f21759b None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:04.646442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd15d6e-da4b-4607-979e-bc51971383b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:04.647235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd15d6e-da4b-4607-979e-bc51971383b2 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:04.647518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd15d6e-da4b-4607-979e-bc51971383b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:04.647820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd15d6e-da4b-4607-979e-bc51971383b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:04.660101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:04.705022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd15d6e-da4b-4607-979e-bc51971383b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:04.706470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd15d6e-da4b-4607-979e-bc51971383b2 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:04.715651 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1172/2382] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:14.393537 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:15.077702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=21 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:17.589990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25683573-0db6-44ed-ae12-c534579fb027 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:17.654585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25683573-0db6-44ed-ae12-c534579fb027 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:17.659157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:17.665720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:17.665720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:17.665720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] PATH_INFO: `/v3/users/571b1178b18f4252a97a74b1ccd76df8` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:17.665720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571b1178b18f4252a97a74b1ccd76df8)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:17.665720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:17.886087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571b1178b18f4252a97a74b1ccd76df8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:17.886761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571b1178b18f4252a97a74b1ccd76df8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:17.887407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571b1178b18f4252a97a74b1ccd76df8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:17.963685 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571b1178b18f4252a97a74b1ccd76df8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:17.972962 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571b1178b18f4252a97a74b1ccd76df8'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:17.992315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1211/2383] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:10:17 2022] DELETE /identity/v3/users/571b1178b18f4252a97a74b1ccd76df8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:17.996821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5229-bdaf-4c22-934e-40e963bb32c3 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:17.997313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5229-bdaf-4c22-934e-40e963bb32c3 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:17.997406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb5229-bdaf-4c22-934e-40e963bb32c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:18.016037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-05fb5229-bdaf-4c22-934e-40e963bb32c3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:18.017247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-05fb5229-bdaf-4c22-934e-40e963bb32c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:18.112178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1173/2384] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:10:18.133129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:18.133129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:18.202645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4664f3-94b6-40d2-891d-de18658e6ab7 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:18.206784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5df30-2ed9-4a5f-99e0-79cfd4f3ec04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:18.207542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5df30-2ed9-4a5f-99e0-79cfd4f3ec04 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:18.207896 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5df30-2ed9-4a5f-99e0-79cfd4f3ec04 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:18.209161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5df30-2ed9-4a5f-99e0-79cfd4f3ec04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:18.221659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5df30-2ed9-4a5f-99e0-79cfd4f3ec04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:18.223233 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5df30-2ed9-4a5f-99e0-79cfd4f3ec04 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:18.244576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1212/2385] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:18.832325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5229-bdaf-4c22-934e-40e963bb32c3 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:18.835130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-05fb5229-bdaf-4c22-934e-40e963bb32c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:18.848490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb5229-bdaf-4c22-934e-40e963bb32c3 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:18.855091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:18.856010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:18.856295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:18.856806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] PATH_INFO: `/v3/projects/df2d2b462ebd4c5897bce1bcc540ef9d` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:18.857818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df2d2b462ebd4c5897bce1bcc540ef9d)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:18.859956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:18.993319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df2d2b462ebd4c5897bce1bcc540ef9d', 'request_id': 'req-5a3fa77b-f4da-4f78-a6de-e39ae6340726'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:18.999052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df2d2b462ebd4c5897bce1bcc540ef9d', 'request_id': 'req-5a3fa77b-f4da-4f78-a6de-e39ae6340726'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:19.006688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df2d2b462ebd4c5897bce1bcc540ef9d', 'request_id': 'req-5a3fa77b-f4da-4f78-a6de-e39ae6340726'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:19.122082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] The token cache is being invalidate because project df2d2b462ebd4c5897bce1bcc540ef9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:10:19.122082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:19.122082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:19.123253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1174/2386] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:10:18 2022] DELETE /identity/v3/projects/df2d2b462ebd4c5897bce1bcc540ef9d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:19.127410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5df30-2ed9-4a5f-99e0-79cfd4f3ec04 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:19.139611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5df30-2ed9-4a5f-99e0-79cfd4f3ec04 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:19.163688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:19.207543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:19.208370 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:19.208653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:19.208930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] PATH_INFO: `/v3/users/55e7240fde174656b5085450dd0c99a1` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:19.210518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e7240fde174656b5085450dd0c99a1)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:19.212932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:19.520915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e7240fde174656b5085450dd0c99a1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:19.521930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e7240fde174656b5085450dd0c99a1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:19.523457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e7240fde174656b5085450dd0c99a1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:19.603661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e7240fde174656b5085450dd0c99a1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:19.611103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3dea978f-7dae-48ef-bdc6-de8b22a1e90a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e7240fde174656b5085450dd0c99a1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:19.628113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1213/2387] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:10:19 2022] DELETE /identity/v3/users/55e7240fde174656b5085450dd0c99a1 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:10:20.045051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:20.046728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:20.065717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fa77b-f4da-4f78-a6de-e39ae6340726 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:20.132887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:20.133751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:20.134032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:20.134310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] PATH_INFO: `/v3/projects/375c6d38442d40e484907d64a1bcf2bc` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:20.135535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=375c6d38442d40e484907d64a1bcf2bc)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:20.137456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:20.262109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:20.278895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375c6d38442d40e484907d64a1bcf2bc', 'request_id': 'req-5fcd49d2-f3f7-4b5f-9886-79a31635f322'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:20.284261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375c6d38442d40e484907d64a1bcf2bc', 'request_id': 'req-5fcd49d2-f3f7-4b5f-9886-79a31635f322'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:20.290438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375c6d38442d40e484907d64a1bcf2bc', 'request_id': 'req-5fcd49d2-f3f7-4b5f-9886-79a31635f322'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:20.478362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] The token cache is being invalidate because project 375c6d38442d40e484907d64a1bcf2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:10:20.479034 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:20.486458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5fcd49d2-f3f7-4b5f-9886-79a31635f322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:20.486458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1175/2388] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:10:20 2022] DELETE /identity/v3/projects/375c6d38442d40e484907d64a1bcf2bc => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:20.490288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967abada-136c-42a8-8864-c6e5b0887a41 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:20.490930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967abada-136c-42a8-8864-c6e5b0887a41 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:20.490930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967abada-136c-42a8-8864-c6e5b0887a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:20.510870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-967abada-136c-42a8-8864-c6e5b0887a41 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:20.512273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-967abada-136c-42a8-8864-c6e5b0887a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:20.575812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1214/2389] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:20.583949 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d261c-45d8-4dfb-a6bf-45460ae33125 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:20.584266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d261c-45d8-4dfb-a6bf-45460ae33125 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:20.585260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d261c-45d8-4dfb-a6bf-45460ae33125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:20.612672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-231d261c-45d8-4dfb-a6bf-45460ae33125 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:20.612672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-231d261c-45d8-4dfb-a6bf-45460ae33125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:20.620396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1176/2390] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:20.624431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967abada-136c-42a8-8864-c6e5b0887a41 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:20.637786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967abada-136c-42a8-8864-c6e5b0887a41 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:20.644805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ed9f7-ec39-42a3-b7f7-7ea64c317103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:20.645447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ed9f7-ec39-42a3-b7f7-7ea64c317103 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:20.645763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ed9f7-ec39-42a3-b7f7-7ea64c317103 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:20.646384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ed9f7-ec39-42a3-b7f7-7ea64c317103 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:20.648057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ed9f7-ec39-42a3-b7f7-7ea64c317103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:10:20.648469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ed9f7-ec39-42a3-b7f7-7ea64c317103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:20.650166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ed9f7-ec39-42a3-b7f7-7ea64c317103 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:20.665575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1215/2391] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:10:20.670172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d261c-45d8-4dfb-a6bf-45460ae33125 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:20.680744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d261c-45d8-4dfb-a6bf-45460ae33125 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:20.685761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c5fa6-38e3-4ed6-bc92-8b7fe63bc551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:20.692884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c5fa6-38e3-4ed6-bc92-8b7fe63bc551 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:20.692884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c5fa6-38e3-4ed6-bc92-8b7fe63bc551 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:20.692884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c5fa6-38e3-4ed6-bc92-8b7fe63bc551 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:20.692884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c5fa6-38e3-4ed6-bc92-8b7fe63bc551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:20.692884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c5fa6-38e3-4ed6-bc92-8b7fe63bc551 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:20.806328 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1177/2392] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:10:20 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:10:20.810155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ed9f7-ec39-42a3-b7f7-7ea64c317103 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:20.821185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ed9f7-ec39-42a3-b7f7-7ea64c317103 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:20.848041 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:20.878858 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6dabf-41e4-4e33-9ab3-228121d3febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:20.879551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6dabf-41e4-4e33-9ab3-228121d3febc admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:20.879836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6dabf-41e4-4e33-9ab3-228121d3febc admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:20.880113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6dabf-41e4-4e33-9ab3-228121d3febc admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:20.880805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6dabf-41e4-4e33-9ab3-228121d3febc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:20.882894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6dabf-41e4-4e33-9ab3-228121d3febc admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:21.019722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1216/2393] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:10:20 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:10:21.024486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c5fa6-38e3-4ed6-bc92-8b7fe63bc551 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:21.034561 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c5fa6-38e3-4ed6-bc92-8b7fe63bc551 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:21.039199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2f19c-b3be-4f0b-8be1-1fc9c9003100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:21.039851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2f19c-b3be-4f0b-8be1-1fc9c9003100 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:21.040165 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2f19c-b3be-4f0b-8be1-1fc9c9003100 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:21.040434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2f19c-b3be-4f0b-8be1-1fc9c9003100 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:21.041155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2f19c-b3be-4f0b-8be1-1fc9c9003100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:21.042744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2f19c-b3be-4f0b-8be1-1fc9c9003100 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:21.052604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1178/2394] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:10:21.058898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6dabf-41e4-4e33-9ab3-228121d3febc admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:21.068860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6dabf-41e4-4e33-9ab3-228121d3febc admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:21.074216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b2823-a666-4fb7-902b-314ecae7bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:21.074863 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b2823-a666-4fb7-902b-314ecae7bfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:21.075179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b2823-a666-4fb7-902b-314ecae7bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:21.075457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b2823-a666-4fb7-902b-314ecae7bfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:21.076179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b2823-a666-4fb7-902b-314ecae7bfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:21.077764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532b2823-a666-4fb7-902b-314ecae7bfb3 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:21.092414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1217/2395] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:10:21.095078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2f19c-b3be-4f0b-8be1-1fc9c9003100 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:21.105439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2f19c-b3be-4f0b-8be1-1fc9c9003100 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:21.109986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d905bf-9ff5-43ca-a531-cd385c9df6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:21.110905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d905bf-9ff5-43ca-a531-cd385c9df6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:21.111220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d905bf-9ff5-43ca-a531-cd385c9df6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:21.111497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d905bf-9ff5-43ca-a531-cd385c9df6e4 admin admin] PATH_INFO: `/v3/projects/794cae1450c440cba4c7c51cad6ec756/users/ab178cc230724ebf8b5f18b96acd87f9/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:21.126679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d905bf-9ff5-43ca-a531-cd385c9df6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794cae1450c440cba4c7c51cad6ec756, user_id=ab178cc230724ebf8b5f18b96acd87f9, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:21.130507 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d905bf-9ff5-43ca-a531-cd385c9df6e4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:21.238445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1179/2396] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:10:21 2022] PUT /identity/v3/projects/794cae1450c440cba4c7c51cad6ec756/users/ab178cc230724ebf8b5f18b96acd87f9/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:21.249923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041717c-6805-4030-87ea-ad7c2c376481 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:21.250214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041717c-6805-4030-87ea-ad7c2c376481 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:21.250487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041717c-6805-4030-87ea-ad7c2c376481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:21.277839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-2041717c-6805-4030-87ea-ad7c2c376481 None None] MFA Rules not processed for user `ab178cc230724ebf8b5f18b96acd87f9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:21.279065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-2041717c-6805-4030-87ea-ad7c2c376481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:21.341891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1218/2397] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:21.346931 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d905bf-9ff5-43ca-a531-cd385c9df6e4 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:21.412254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d905bf-9ff5-43ca-a531-cd385c9df6e4 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:21.418025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72b5e2-7ae5-44f1-af79-26126acb394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:21.418658 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72b5e2-7ae5-44f1-af79-26126acb394d admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:21.418938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72b5e2-7ae5-44f1-af79-26126acb394d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:21.419242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72b5e2-7ae5-44f1-af79-26126acb394d admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:21.419941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72b5e2-7ae5-44f1-af79-26126acb394d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:21.421861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72b5e2-7ae5-44f1-af79-26126acb394d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:21.582594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1180/2398] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:10:21 2022] POST /identity/v3/projects => generated 387 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:10:21.587653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041717c-6805-4030-87ea-ad7c2c376481 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:21.598641 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041717c-6805-4030-87ea-ad7c2c376481 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:21.654960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb709eb-ba6f-4b71-8bc0-bdf22d980512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:21.655588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb709eb-ba6f-4b71-8bc0-bdf22d980512 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:21.655864 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb709eb-ba6f-4b71-8bc0-bdf22d980512 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:21.656135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb709eb-ba6f-4b71-8bc0-bdf22d980512 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:21.656838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb709eb-ba6f-4b71-8bc0-bdf22d980512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:21.658799 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb709eb-ba6f-4b71-8bc0-bdf22d980512 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:21.741135 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1219/2399] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:10:21 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:10:21.745304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72b5e2-7ae5-44f1-af79-26126acb394d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:21.755941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72b5e2-7ae5-44f1-af79-26126acb394d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:21.761387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf38ffb-2848-44d1-8cde-517c6dcf1e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:21.762062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf38ffb-2848-44d1-8cde-517c6dcf1e0f admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:21.762342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf38ffb-2848-44d1-8cde-517c6dcf1e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:21.762782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf38ffb-2848-44d1-8cde-517c6dcf1e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:21.763538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf38ffb-2848-44d1-8cde-517c6dcf1e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:21.765138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf38ffb-2848-44d1-8cde-517c6dcf1e0f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:21.778336 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1181/2400] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:10:21.782829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb709eb-ba6f-4b71-8bc0-bdf22d980512 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:21.794855 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb709eb-ba6f-4b71-8bc0-bdf22d980512 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:21.799838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bb594-51c1-4611-a5f1-aaebbabb0482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:21.800713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bb594-51c1-4611-a5f1-aaebbabb0482 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:21.800999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bb594-51c1-4611-a5f1-aaebbabb0482 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:21.801276 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bb594-51c1-4611-a5f1-aaebbabb0482 admin admin] PATH_INFO: `/v3/projects/6625fbb9235e4dbbadd396391396c674/users/ba85bc26048e41b3bdbbea193767a11c/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:21.817295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bb594-51c1-4611-a5f1-aaebbabb0482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6625fbb9235e4dbbadd396391396c674, user_id=ba85bc26048e41b3bdbbea193767a11c, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:21.821176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bb594-51c1-4611-a5f1-aaebbabb0482 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:21.906749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1220/2401] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:10:21 2022] PUT /identity/v3/projects/6625fbb9235e4dbbadd396391396c674/users/ba85bc26048e41b3bdbbea193767a11c/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:21.910686 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf38ffb-2848-44d1-8cde-517c6dcf1e0f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:21.920926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf38ffb-2848-44d1-8cde-517c6dcf1e0f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:21.942370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:21.979513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e64b0e-4c08-4500-81ea-8c1a7163f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:21.980200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e64b0e-4c08-4500-81ea-8c1a7163f179 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:21.980660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e64b0e-4c08-4500-81ea-8c1a7163f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:21.980936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e64b0e-4c08-4500-81ea-8c1a7163f179 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:21.981662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e64b0e-4c08-4500-81ea-8c1a7163f179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:21.983432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e64b0e-4c08-4500-81ea-8c1a7163f179 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:21.994791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1182/2402] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:10:21.999035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bb594-51c1-4611-a5f1-aaebbabb0482 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:22.004755 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:22.012024 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bb594-51c1-4611-a5f1-aaebbabb0482 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:22.016770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baab9c-5467-4546-ad85-b3bc468ae4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:22.017702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baab9c-5467-4546-ad85-b3bc468ae4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:22.017988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baab9c-5467-4546-ad85-b3bc468ae4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:22.018266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baab9c-5467-4546-ad85-b3bc468ae4d7 admin admin] PATH_INFO: `/v3/projects/6625fbb9235e4dbbadd396391396c674/users/ba85bc26048e41b3bdbbea193767a11c/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:22.020262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baab9c-5467-4546-ad85-b3bc468ae4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6625fbb9235e4dbbadd396391396c674, user_id=ba85bc26048e41b3bdbbea193767a11c, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:22.023422 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baab9c-5467-4546-ad85-b3bc468ae4d7 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:22.034050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1221/2403] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:10:21 2022] PUT /identity/v3/projects/6625fbb9235e4dbbadd396391396c674/users/ba85bc26048e41b3bdbbea193767a11c/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:10:22.044842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf30ac9-1429-4f40-a830-7c3df9ba7c3d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:22.045224 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf30ac9-1429-4f40-a830-7c3df9ba7c3d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:22.045505 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf30ac9-1429-4f40-a830-7c3df9ba7c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:22.073597 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fbf30ac9-1429-4f40-a830-7c3df9ba7c3d None None] MFA Rules not processed for user `ba85bc26048e41b3bdbbea193767a11c`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:22.074827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fbf30ac9-1429-4f40-a830-7c3df9ba7c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:22.146067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1183/2404] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:22.158072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baab9c-5467-4546-ad85-b3bc468ae4d7 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:22.159686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d3baab9c-5467-4546-ad85-b3bc468ae4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:22.220080 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baab9c-5467-4546-ad85-b3bc468ae4d7 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:22.223777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afbc36-fa17-43b8-b3c7-a38d3cac5533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:22.224419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afbc36-fa17-43b8-b3c7-a38d3cac5533 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:22.224800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afbc36-fa17-43b8-b3c7-a38d3cac5533 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:22.225530 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afbc36-fa17-43b8-b3c7-a38d3cac5533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:22.234926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afbc36-fa17-43b8-b3c7-a38d3cac5533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:22.236430 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afbc36-fa17-43b8-b3c7-a38d3cac5533 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:22.249024 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1222/2405] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:22.276187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf30ac9-1429-4f40-a830-7c3df9ba7c3d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:22.338664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf30ac9-1429-4f40-a830-7c3df9ba7c3d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:22.343324 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:22.345001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:22.345001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:22.345001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] PATH_INFO: `/v3/users/ab178cc230724ebf8b5f18b96acd87f9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:22.345945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab178cc230724ebf8b5f18b96acd87f9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:22.347905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:22.617918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab178cc230724ebf8b5f18b96acd87f9'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:22.618580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab178cc230724ebf8b5f18b96acd87f9'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:22.619213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab178cc230724ebf8b5f18b96acd87f9'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:22.620443 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:22.626744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab178cc230724ebf8b5f18b96acd87f9'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:22.639307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab178cc230724ebf8b5f18b96acd87f9'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:22.803940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1184/2406] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:10:22 2022] DELETE /identity/v3/users/ab178cc230724ebf8b5f18b96acd87f9 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:22.808737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64714b5f-25f9-488d-9d91-bfba9e8210a9 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:22.809486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64714b5f-25f9-488d-9d91-bfba9e8210a9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:22.809753 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64714b5f-25f9-488d-9d91-bfba9e8210a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:22.828424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-64714b5f-25f9-488d-9d91-bfba9e8210a9 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:22.829644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-64714b5f-25f9-488d-9d91-bfba9e8210a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:22.889668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1223/2407] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:22.900980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:22.902063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:22.970613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a7152-d3e2-4b01-9dab-018d0fa329fc admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:22.974484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef59a2-6941-4a78-8712-001ab5854d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:22.975307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef59a2-6941-4a78-8712-001ab5854d0f service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:22.975677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef59a2-6941-4a78-8712-001ab5854d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:22.975951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef59a2-6941-4a78-8712-001ab5854d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:22.985425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef59a2-6941-4a78-8712-001ab5854d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:22.986868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef59a2-6941-4a78-8712-001ab5854d0f service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:22.996774 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1185/2408] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:23.027057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192607a-d547-4490-97ea-717fb9b8f44c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:23.027402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192607a-d547-4490-97ea-717fb9b8f44c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:23.027620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192607a-d547-4490-97ea-717fb9b8f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:23.047989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-3192607a-d547-4490-97ea-717fb9b8f44c None None] MFA Rules not processed for user `2e7ba82a80834a4aa098e9604165cfad`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:23.049203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3192607a-d547-4490-97ea-717fb9b8f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:23.118683 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1224/2409] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:23.514860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef59a2-6941-4a78-8712-001ab5854d0f service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:23.516448 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-17ef59a2-6941-4a78-8712-001ab5854d0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:23.542536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef59a2-6941-4a78-8712-001ab5854d0f service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:23.548565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:23.549502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:23.549851 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:23.550204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] PATH_INFO: `/v3/projects/794cae1450c440cba4c7c51cad6ec756` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:23.551481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=794cae1450c440cba4c7c51cad6ec756)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:23.554316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:23.675748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794cae1450c440cba4c7c51cad6ec756', 'request_id': 'req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:23.683231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794cae1450c440cba4c7c51cad6ec756', 'request_id': 'req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:23.690514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794cae1450c440cba4c7c51cad6ec756', 'request_id': 'req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:23.774581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] The token cache is being invalidate because project 794cae1450c440cba4c7c51cad6ec756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:10:23.774801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:23.775466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:23.777029 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1186/2410] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:10:23 2022] DELETE /identity/v3/projects/794cae1450c440cba4c7c51cad6ec756 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:23.781149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192607a-d547-4490-97ea-717fb9b8f44c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:23.792474 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192607a-d547-4490-97ea-717fb9b8f44c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:23.827000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:23.852929 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:23.853931 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:23.854277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:23.854618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] PATH_INFO: `/v3/users/ba85bc26048e41b3bdbbea193767a11c` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:23.856456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba85bc26048e41b3bdbbea193767a11c)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:23.858500 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:24.068260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba85bc26048e41b3bdbbea193767a11c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:24.069224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba85bc26048e41b3bdbbea193767a11c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:24.069834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba85bc26048e41b3bdbbea193767a11c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:24.140693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba85bc26048e41b3bdbbea193767a11c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:24.149402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2e30d044-3189-4ad7-a512-854c036f9f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba85bc26048e41b3bdbbea193767a11c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:24.169032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1225/2411] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:10:23 2022] DELETE /identity/v3/users/ba85bc26048e41b3bdbbea193767a11c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:24.662645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:24.664453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:24.687612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd82ae-3d6b-435d-9a70-620dc0853d6c admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:24.738259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:24.748633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:24.749500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:24.749785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:24.750076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] PATH_INFO: `/v3/projects/6625fbb9235e4dbbadd396391396c674` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:24.751282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6625fbb9235e4dbbadd396391396c674)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:24.753228 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:24.902251 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6625fbb9235e4dbbadd396391396c674', 'request_id': 'req-972f4ad9-f4bc-417b-9021-bb7386585318'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:24.907759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6625fbb9235e4dbbadd396391396c674', 'request_id': 'req-972f4ad9-f4bc-417b-9021-bb7386585318'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:24.920254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6625fbb9235e4dbbadd396391396c674', 'request_id': 'req-972f4ad9-f4bc-417b-9021-bb7386585318'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:25.035941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] The token cache is being invalidate because project 6625fbb9235e4dbbadd396391396c674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:10:25.038290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:25.038290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-972f4ad9-f4bc-417b-9021-bb7386585318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:25.038489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1187/2412] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:10:24 2022] DELETE /identity/v3/projects/6625fbb9235e4dbbadd396391396c674 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:25.044789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f5dbb-efc6-4f25-8e92-8e61fe78db6e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:25.045255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f5dbb-efc6-4f25-8e92-8e61fe78db6e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:25.045368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f5dbb-efc6-4f25-8e92-8e61fe78db6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:25.064271 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-327f5dbb-efc6-4f25-8e92-8e61fe78db6e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:25.065472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-327f5dbb-efc6-4f25-8e92-8e61fe78db6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:25.127540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1226/2413] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:25.136673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142d4d-345b-4b13-8ccc-c0b7c40dea9d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:25.137112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142d4d-345b-4b13-8ccc-c0b7c40dea9d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:25.137414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19142d4d-345b-4b13-8ccc-c0b7c40dea9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:25.158631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-19142d4d-345b-4b13-8ccc-c0b7c40dea9d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:25.159829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-19142d4d-345b-4b13-8ccc-c0b7c40dea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:25.169386 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1188/2414] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:10:25.173743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f5dbb-efc6-4f25-8e92-8e61fe78db6e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:25.184573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f5dbb-efc6-4f25-8e92-8e61fe78db6e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:25.190155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1a589-a71d-4891-a7b2-5a8b99673201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:25.190806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1a589-a71d-4891-a7b2-5a8b99673201 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:25.191235 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1a589-a71d-4891-a7b2-5a8b99673201 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:25.191369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1a589-a71d-4891-a7b2-5a8b99673201 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:25.192093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1a589-a71d-4891-a7b2-5a8b99673201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:10:25.192563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1a589-a71d-4891-a7b2-5a8b99673201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:25.194301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1a589-a71d-4891-a7b2-5a8b99673201 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:25.206987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1227/2415] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:10:25.212298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142d4d-345b-4b13-8ccc-c0b7c40dea9d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:25.222097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19142d4d-345b-4b13-8ccc-c0b7c40dea9d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:25.228009 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47471ca-4bbf-43be-9e80-8eec7e1948be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:25.228754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47471ca-4bbf-43be-9e80-8eec7e1948be admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:25.229129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47471ca-4bbf-43be-9e80-8eec7e1948be admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:25.229429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47471ca-4bbf-43be-9e80-8eec7e1948be admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:25.230307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47471ca-4bbf-43be-9e80-8eec7e1948be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:25.232299 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47471ca-4bbf-43be-9e80-8eec7e1948be admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:25.348417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1189/2416] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:10:25 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:10:25.358406 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1a589-a71d-4891-a7b2-5a8b99673201 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:25.370927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1a589-a71d-4891-a7b2-5a8b99673201 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:25.417787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:25.432397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765d2c-cab0-4cd1-9f07-e7dd32edc3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:25.433068 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765d2c-cab0-4cd1-9f07-e7dd32edc3fd admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:25.433352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765d2c-cab0-4cd1-9f07-e7dd32edc3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:25.433630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765d2c-cab0-4cd1-9f07-e7dd32edc3fd admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:25.434316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765d2c-cab0-4cd1-9f07-e7dd32edc3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:25.436279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765d2c-cab0-4cd1-9f07-e7dd32edc3fd admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:25.540780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1228/2417] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:10:25 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:10:25.544972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47471ca-4bbf-43be-9e80-8eec7e1948be admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:25.556388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47471ca-4bbf-43be-9e80-8eec7e1948be admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:25.561004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cee2e1-95e1-44f9-862f-1faf316f2f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:25.561656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cee2e1-95e1-44f9-862f-1faf316f2f66 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:25.561938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cee2e1-95e1-44f9-862f-1faf316f2f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:25.562210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cee2e1-95e1-44f9-862f-1faf316f2f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:25.562930 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cee2e1-95e1-44f9-862f-1faf316f2f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:25.564556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cee2e1-95e1-44f9-862f-1faf316f2f66 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:25.576061 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1190/2418] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:10:25.579927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765d2c-cab0-4cd1-9f07-e7dd32edc3fd admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:25.591050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765d2c-cab0-4cd1-9f07-e7dd32edc3fd admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:25.595681 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf8d56-5995-4b10-bf30-a605c5387fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:25.596336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8d56-5995-4b10-bf30-a605c5387fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:25.596623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8d56-5995-4b10-bf30-a605c5387fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:25.596901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8d56-5995-4b10-bf30-a605c5387fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:25.597624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf8d56-5995-4b10-bf30-a605c5387fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:25.599246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf8d56-5995-4b10-bf30-a605c5387fc2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:25.611057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1229/2419] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:10:25.615221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cee2e1-95e1-44f9-862f-1faf316f2f66 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:25.625986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cee2e1-95e1-44f9-862f-1faf316f2f66 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:25.630563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8a2e6-0651-4151-978e-98ba499636b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:25.632211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8a2e6-0651-4151-978e-98ba499636b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:25.632492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8a2e6-0651-4151-978e-98ba499636b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:25.632770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8a2e6-0651-4151-978e-98ba499636b5 admin admin] PATH_INFO: `/v3/projects/b6844bac43e445aaba8bab4834f74db1/users/c4a9eeae8e7e47248825f45c7e631581/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:25.648842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8a2e6-0651-4151-978e-98ba499636b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6844bac43e445aaba8bab4834f74db1, user_id=c4a9eeae8e7e47248825f45c7e631581, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:25.651583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8a2e6-0651-4151-978e-98ba499636b5 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:25.733788 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1191/2420] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:10:25 2022] PUT /identity/v3/projects/b6844bac43e445aaba8bab4834f74db1/users/c4a9eeae8e7e47248825f45c7e631581/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:25.746115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb513f-fa92-465a-9bdc-f3dc78f29876 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:25.746405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb513f-fa92-465a-9bdc-f3dc78f29876 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:25.746688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb513f-fa92-465a-9bdc-f3dc78f29876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:25.773464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-aceb513f-fa92-465a-9bdc-f3dc78f29876 None None] MFA Rules not processed for user `c4a9eeae8e7e47248825f45c7e631581`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:25.774682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-aceb513f-fa92-465a-9bdc-f3dc78f29876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:25.838350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1230/2421] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:25.849614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8a2e6-0651-4151-978e-98ba499636b5 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:25.851452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-68b8a2e6-0651-4151-978e-98ba499636b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:25.907975 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8a2e6-0651-4151-978e-98ba499636b5 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:25.911681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35e2ad-cfa5-4e29-9258-c0648bb5d535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:25.912327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e2ad-cfa5-4e29-9258-c0648bb5d535 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:25.913149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e2ad-cfa5-4e29-9258-c0648bb5d535 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:25.913665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e2ad-cfa5-4e29-9258-c0648bb5d535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:25.922166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35e2ad-cfa5-4e29-9258-c0648bb5d535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:25.923693 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35e2ad-cfa5-4e29-9258-c0648bb5d535 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:25.933182 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1192/2422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:30.164969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb513f-fa92-465a-9bdc-f3dc78f29876 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:30.228972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb513f-fa92-465a-9bdc-f3dc78f29876 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:30.234090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:30.234499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:30.234783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:30.235287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] PATH_INFO: `/v3/users/c4a9eeae8e7e47248825f45c7e631581` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:30.236943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a9eeae8e7e47248825f45c7e631581)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:30.239081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:30.438621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a9eeae8e7e47248825f45c7e631581'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:30.439315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a9eeae8e7e47248825f45c7e631581'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:30.439912 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a9eeae8e7e47248825f45c7e631581'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:30.521554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a9eeae8e7e47248825f45c7e631581'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:30.523171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:30.529312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a9eeae8e7e47248825f45c7e631581'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:30.546326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1231/2423] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:10:30 2022] DELETE /identity/v3/users/c4a9eeae8e7e47248825f45c7e631581 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:30.550929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395be0-bde2-4aa3-bbb7-52b9726b64fd None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:30.551433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395be0-bde2-4aa3-bbb7-52b9726b64fd None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:30.551559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79395be0-bde2-4aa3-bbb7-52b9726b64fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:30.569138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-79395be0-bde2-4aa3-bbb7-52b9726b64fd None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:30.570397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-79395be0-bde2-4aa3-bbb7-52b9726b64fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:30.582793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:30.629329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1193/2424] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:30.639314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:30.640740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:30.703194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdbfe8-1c89-4864-9bc6-1c46a7cd0d66 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:30.707451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be0ee6-f5d8-48c6-9498-78b197e135c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:30.708149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0ee6-f5d8-48c6-9498-78b197e135c5 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:30.708435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0ee6-f5d8-48c6-9498-78b197e135c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:30.708713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be0ee6-f5d8-48c6-9498-78b197e135c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:30.718363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0ee6-f5d8-48c6-9498-78b197e135c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:30.719831 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be0ee6-f5d8-48c6-9498-78b197e135c5 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:30.730491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1232/2425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:31.188361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79395be0-bde2-4aa3-bbb7-52b9726b64fd None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:31.189800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-79395be0-bde2-4aa3-bbb7-52b9726b64fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:31.202496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79395be0-bde2-4aa3-bbb7-52b9726b64fd None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:31.208214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:31.209081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:31.209537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:31.210662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] PATH_INFO: `/v3/projects/b6844bac43e445aaba8bab4834f74db1` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:31.212479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6844bac43e445aaba8bab4834f74db1)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:31.214253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:31.368694 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6844bac43e445aaba8bab4834f74db1', 'request_id': 'req-63ac5606-fa75-481d-98b1-7922331a64cd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:31.374444 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6844bac43e445aaba8bab4834f74db1', 'request_id': 'req-63ac5606-fa75-481d-98b1-7922331a64cd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:31.380904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6844bac43e445aaba8bab4834f74db1', 'request_id': 'req-63ac5606-fa75-481d-98b1-7922331a64cd'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:31.489252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] The token cache is being invalidate because project b6844bac43e445aaba8bab4834f74db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:10:31.489548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:31.490190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-63ac5606-fa75-481d-98b1-7922331a64cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:10:31.493328 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1194/2426] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:10:31 2022] DELETE /identity/v3/projects/b6844bac43e445aaba8bab4834f74db1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:10:31.502923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64851e-a45d-46aa-a34f-815467c017ce None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:31.503414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64851e-a45d-46aa-a34f-815467c017ce None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:31.503523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64851e-a45d-46aa-a34f-815467c017ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:31.522765 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-aa64851e-a45d-46aa-a34f-815467c017ce None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:31.523999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-aa64851e-a45d-46aa-a34f-815467c017ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:31.585384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1233/2427] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:31.593392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e501-9a78-4030-9661-92bfd4764f48 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:31.593897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e501-9a78-4030-9661-92bfd4764f48 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:31.593996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e501-9a78-4030-9661-92bfd4764f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:31.612602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-d515e501-9a78-4030-9661-92bfd4764f48 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:31.618909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d515e501-9a78-4030-9661-92bfd4764f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:31.622678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1195/2428] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:10:31.627124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64851e-a45d-46aa-a34f-815467c017ce None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:31.637918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64851e-a45d-46aa-a34f-815467c017ce None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:31.642571 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc3996-ae69-470e-872d-1b05ddfc9ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:31.643246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc3996-ae69-470e-872d-1b05ddfc9ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:31.643534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc3996-ae69-470e-872d-1b05ddfc9ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:31.643811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc3996-ae69-470e-872d-1b05ddfc9ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:31.644531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc3996-ae69-470e-872d-1b05ddfc9ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:10:31.644841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc3996-ae69-470e-872d-1b05ddfc9ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:31.646454 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc3996-ae69-470e-872d-1b05ddfc9ae6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:31.658499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1234/2429] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:10:31.662934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e501-9a78-4030-9661-92bfd4764f48 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:31.672743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e501-9a78-4030-9661-92bfd4764f48 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:31.679107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637be7f4-c169-4b4a-9356-ebc9a082d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:31.679759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637be7f4-c169-4b4a-9356-ebc9a082d1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:31.680051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637be7f4-c169-4b4a-9356-ebc9a082d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:31.680330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637be7f4-c169-4b4a-9356-ebc9a082d1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:31.681034 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637be7f4-c169-4b4a-9356-ebc9a082d1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:31.685301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637be7f4-c169-4b4a-9356-ebc9a082d1c4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:31.776813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1196/2430] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:10:31 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:10:31.781026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc3996-ae69-470e-872d-1b05ddfc9ae6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:31.791307 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc3996-ae69-470e-872d-1b05ddfc9ae6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:31.852687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad25e5-eb58-4e4d-8fb5-241651ec06e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:31.853372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad25e5-eb58-4e4d-8fb5-241651ec06e9 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:31.853656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad25e5-eb58-4e4d-8fb5-241651ec06e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:31.854110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad25e5-eb58-4e4d-8fb5-241651ec06e9 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:31.854823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad25e5-eb58-4e4d-8fb5-241651ec06e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:31.857509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad25e5-eb58-4e4d-8fb5-241651ec06e9 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:31.866080 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:31.875544 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50d931-d0dc-41a4-ad5d-161819357b99 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:31.875917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50d931-d0dc-41a4-ad5d-161819357b99 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:31.876258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50d931-d0dc-41a4-ad5d-161819357b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:31.896706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-2c50d931-d0dc-41a4-ad5d-161819357b99 None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:31.898391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2c50d931-d0dc-41a4-ad5d-161819357b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:31.988021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1197/2431] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:10:32.072479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1235/2432] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:10:31 2022] POST /identity/v3/users => generated 283 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:10:32.076454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50d931-d0dc-41a4-ad5d-161819357b99 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:32.088056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50d931-d0dc-41a4-ad5d-161819357b99 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:32.092728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96b667-a59e-4e93-a637-bf5536c11588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:32.093344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96b667-a59e-4e93-a637-bf5536c11588 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:32.093629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96b667-a59e-4e93-a637-bf5536c11588 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:32.093905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96b667-a59e-4e93-a637-bf5536c11588 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:32.094633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96b667-a59e-4e93-a637-bf5536c11588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:32.096266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96b667-a59e-4e93-a637-bf5536c11588 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:32.106843 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1198/2433] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:10:32.111237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad25e5-eb58-4e4d-8fb5-241651ec06e9 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:32.121893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad25e5-eb58-4e4d-8fb5-241651ec06e9 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:32.127152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f3ce-cc85-4416-b3e9-42b4a39d9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:32.127720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f3ce-cc85-4416-b3e9-42b4a39d9c6f admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:32.128002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f3ce-cc85-4416-b3e9-42b4a39d9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:32.128278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f3ce-cc85-4416-b3e9-42b4a39d9c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:32.129023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7f3ce-cc85-4416-b3e9-42b4a39d9c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:32.130594 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7f3ce-cc85-4416-b3e9-42b4a39d9c6f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:32.132027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96b667-a59e-4e93-a637-bf5536c11588 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:32.133741 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1d96b667-a59e-4e93-a637-bf5536c11588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:32.145916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1236/2434] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:10:32.146062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:32.147299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f3ce-cc85-4416-b3e9-42b4a39d9c6f admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:32.158690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f3ce-cc85-4416-b3e9-42b4a39d9c6f admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:32.164054 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981293-fd5f-4adf-b26f-70f9304a6bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:32.165063 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981293-fd5f-4adf-b26f-70f9304a6bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:32.165351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981293-fd5f-4adf-b26f-70f9304a6bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:32.165629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981293-fd5f-4adf-b26f-70f9304a6bc6 admin admin] PATH_INFO: `/v3/projects/ab468c9840f34840a4a83911a515d8b4/users/d6aed5d4150446e484fc3d1484c147ee/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:32.181366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981293-fd5f-4adf-b26f-70f9304a6bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab468c9840f34840a4a83911a515d8b4, user_id=d6aed5d4150446e484fc3d1484c147ee, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:32.184150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981293-fd5f-4adf-b26f-70f9304a6bc6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:32.207582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96b667-a59e-4e93-a637-bf5536c11588 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:32.213375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4607a2b-c962-4657-94e8-ab4991540f52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:32.213934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4607a2b-c962-4657-94e8-ab4991540f52 service swift] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:32.214219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4607a2b-c962-4657-94e8-ab4991540f52 service swift] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:32.214498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4607a2b-c962-4657-94e8-ab4991540f52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:32.222709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4607a2b-c962-4657-94e8-ab4991540f52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:32.224330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4607a2b-c962-4657-94e8-ab4991540f52 service swift] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:32.233010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1199/2435] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:10:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 14:10:32.250524 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1237/2436] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:10:32 2022] PUT /identity/v3/projects/ab468c9840f34840a4a83911a515d8b4/users/d6aed5d4150446e484fc3d1484c147ee/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:10:32.266583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc320eff-d4da-4e59-aa09-92a65156da4b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:32.271314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc320eff-d4da-4e59-aa09-92a65156da4b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:32.271974 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc320eff-d4da-4e59-aa09-92a65156da4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:32.312552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-fc320eff-d4da-4e59-aa09-92a65156da4b None None] MFA Rules not processed for user `d6aed5d4150446e484fc3d1484c147ee`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:32.314916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fc320eff-d4da-4e59-aa09-92a65156da4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:32.393804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1200/2437] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:10:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:32.405560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981293-fd5f-4adf-b26f-70f9304a6bc6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:32.407316 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-79981293-fd5f-4adf-b26f-70f9304a6bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:32.473935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981293-fd5f-4adf-b26f-70f9304a6bc6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:32.479613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3fc4-7c4c-4d93-84f9-aec58352e7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:32.480387 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3fc4-7c4c-4d93-84f9-aec58352e7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:32.480672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3fc4-7c4c-4d93-84f9-aec58352e7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:32.480947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3fc4-7c4c-4d93-84f9-aec58352e7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:32.490013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b3fc4-7c4c-4d93-84f9-aec58352e7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:32.491451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b3fc4-7c4c-4d93-84f9-aec58352e7a3 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:32.521540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1238/2438] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:42.390921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=60 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:42.511295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:INSERT=3,keystone:SELECT=43 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:10:50.869017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7d7a-e58a-4438-b529-090bc3fd3159 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:50.869512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7d7a-e58a-4438-b529-090bc3fd3159 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:50.869626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b7d7a-e58a-4438-b529-090bc3fd3159 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:50.870956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1201/2439] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:10:50.877696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf60645-9f6e-45b6-a043-3347f14e4b0e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:50.878188 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf60645-9f6e-45b6-a043-3347f14e4b0e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:50.878394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf60645-9f6e-45b6-a043-3347f14e4b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:50.896661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-fcf60645-9f6e-45b6-a043-3347f14e4b0e None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:50.897921 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-fcf60645-9f6e-45b6-a043-3347f14e4b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:50.964827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1239/2440] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:10:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:10:50.976585 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b7d7a-e58a-4438-b529-090bc3fd3159 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:50.978383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9b3b7d7a-e58a-4438-b529-090bc3fd3159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:51.036672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b7d7a-e58a-4438-b529-090bc3fd3159 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:51.040871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85414c32-9795-4313-be89-3381c286abaf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb36541c7ba418a843e5ecbb1f1e337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:51.041509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414c32-9795-4313-be89-3381c286abaf service glance] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:51.041793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414c32-9795-4313-be89-3381c286abaf service glance] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:51.042094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85414c32-9795-4313-be89-3381c286abaf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:51.052225 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414c32-9795-4313-be89-3381c286abaf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:51.055208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85414c32-9795-4313-be89-3381c286abaf service glance] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:51.064270 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1202/2441] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:51.277300 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483dfac-8187-4ec1-8630-9f6ab18006fb None None] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:51.277594 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483dfac-8187-4ec1-8630-9f6ab18006fb None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:51.277875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483dfac-8187-4ec1-8630-9f6ab18006fb None None] PATH_INFO: `/` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:51.279305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1240/2442] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:10:51.284145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297830e-b04b-44ff-8070-8d6fd0c58df0 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:51.284437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297830e-b04b-44ff-8070-8d6fd0c58df0 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:51.284715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297830e-b04b-44ff-8070-8d6fd0c58df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:51.303514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-b297830e-b04b-44ff-8070-8d6fd0c58df0 None None] MFA Rules not processed for user `7afc19dc502f425faf693eb963fe63d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:51.304707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b297830e-b04b-44ff-8070-8d6fd0c58df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:51.371334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1203/2443] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:10:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:51.384077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483dfac-8187-4ec1-8630-9f6ab18006fb None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:51.387360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3483dfac-8187-4ec1-8630-9f6ab18006fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:51.399432 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483dfac-8187-4ec1-8630-9f6ab18006fb None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:51.402909 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0bacd-2e1a-4d7e-9f67-23a93ca8f2e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:51.403569 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0bacd-2e1a-4d7e-9f67-23a93ca8f2e8 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:51.403854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0bacd-2e1a-4d7e-9f67-23a93ca8f2e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:51.404126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0bacd-2e1a-4d7e-9f67-23a93ca8f2e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:51.411447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0bacd-2e1a-4d7e-9f67-23a93ca8f2e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:51.412861 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0bacd-2e1a-4d7e-9f67-23a93ca8f2e8 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:51.423405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1241/2444] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:51.517550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f94d0-3c8a-42a2-b867-cdc4ea16dd7b None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:51.518025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f94d0-3c8a-42a2-b867-cdc4ea16dd7b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:51.518469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f94d0-3c8a-42a2-b867-cdc4ea16dd7b None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:51.520324 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1204/2445] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:10:51.526663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdd72c-7645-48f1-8c74-8d163e625917 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:51.526988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdd72c-7645-48f1-8c74-8d163e625917 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:51.527327 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdd72c-7645-48f1-8c74-8d163e625917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:51.561850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-bccdd72c-7645-48f1-8c74-8d163e625917 None None] MFA Rules not processed for user `9a1644fa5cd3499d9d6ad057067255e9`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:51.561850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bccdd72c-7645-48f1-8c74-8d163e625917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:51.572445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1242/2446] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:10:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:51.585115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f94d0-3c8a-42a2-b867-cdc4ea16dd7b None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:51.596413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f94d0-3c8a-42a2-b867-cdc4ea16dd7b None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:51.599974 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb65517-766b-4539-82c3-f20877f211b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:51.601273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb65517-766b-4539-82c3-f20877f211b4 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:51.601617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb65517-766b-4539-82c3-f20877f211b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:51.602000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb65517-766b-4539-82c3-f20877f211b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:51.614665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb65517-766b-4539-82c3-f20877f211b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:51.616138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb65517-766b-4539-82c3-f20877f211b4 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:51.627857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1205/2447] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:10:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:10:54.075048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf67e2c-d47b-4195-8d44-c6784e76fb9e None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:54.075552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf67e2c-d47b-4195-8d44-c6784e76fb9e None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:54.075656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf67e2c-d47b-4195-8d44-c6784e76fb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:54.094177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-2cf67e2c-d47b-4195-8d44-c6784e76fb9e None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:10:54.094817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-2cf67e2c-d47b-4195-8d44-c6784e76fb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:10:54.151372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1243/2448] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:10:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:10:54.163571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb65517-766b-4539-82c3-f20877f211b4 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:10:54.233194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb65517-766b-4539-82c3-f20877f211b4 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:10:54.238441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3e4b7-08f0-40ea-9ac2-dc14f43c7206 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:10:54.239128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3e4b7-08f0-40ea-9ac2-dc14f43c7206 service swift] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:10:54.239414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3e4b7-08f0-40ea-9ac2-dc14f43c7206 service swift] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:10:54.239751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3e4b7-08f0-40ea-9ac2-dc14f43c7206 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:10:54.249156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3e4b7-08f0-40ea-9ac2-dc14f43c7206 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:10:54.251004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3e4b7-08f0-40ea-9ac2-dc14f43c7206 service swift] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:10:54.259952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1206/2449] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:10:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:11:04.144240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=65 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:04.256114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=87 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:06.233739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf67e2c-d47b-4195-8d44-c6784e76fb9e None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:06.243888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf67e2c-d47b-4195-8d44-c6784e76fb9e None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:06.247841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe0eb8-bd62-437e-b3d4-c9b974d5ac68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:06.248629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0eb8-bd62-437e-b3d4-c9b974d5ac68 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:06.248919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0eb8-bd62-437e-b3d4-c9b974d5ac68 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:06.249189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe0eb8-bd62-437e-b3d4-c9b974d5ac68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:06.251021 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-72fe0eb8-bd62-437e-b3d4-c9b974d5ac68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:06.265362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe0eb8-bd62-437e-b3d4-c9b974d5ac68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:06.267109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe0eb8-bd62-437e-b3d4-c9b974d5ac68 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:06.278884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1244/2450] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:11:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:11:07.463869 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3e4b7-08f0-40ea-9ac2-dc14f43c7206 service swift] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:07.465358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f6d3e4b7-08f0-40ea-9ac2-dc14f43c7206 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:07.477993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3e4b7-08f0-40ea-9ac2-dc14f43c7206 service swift] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:07.481749 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797aa1e-b350-41cf-9369-6871b1f0a3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:07.482477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797aa1e-b350-41cf-9369-6871b1f0a3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:07.482775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797aa1e-b350-41cf-9369-6871b1f0a3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:07.483077 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797aa1e-b350-41cf-9369-6871b1f0a3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:07.484955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1797aa1e-b350-41cf-9369-6871b1f0a3b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:07.499632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797aa1e-b350-41cf-9369-6871b1f0a3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:07.501111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797aa1e-b350-41cf-9369-6871b1f0a3b8 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:07.512047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1207/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:11:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:11:14.102107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a87ef-ec1e-4435-98bd-8f3578bd0d8b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:14.105352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a87ef-ec1e-4435-98bd-8f3578bd0d8b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:14.105352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a87ef-ec1e-4435-98bd-8f3578bd0d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:14.121725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-e52a87ef-ec1e-4435-98bd-8f3578bd0d8b None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:11:14.123022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-e52a87ef-ec1e-4435-98bd-8f3578bd0d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:14.130440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1245/2452] 10.222.0.42 () {58 vars in 967 bytes} [Fri May 27 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:11:14.142645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797aa1e-b350-41cf-9369-6871b1f0a3b8 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:14.153908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797aa1e-b350-41cf-9369-6871b1f0a3b8 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:14.158780 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3497e-2710-4414-8ef8-6b224fc4ff9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:14.159454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3497e-2710-4414-8ef8-6b224fc4ff9b service swift] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:14.159726 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3497e-2710-4414-8ef8-6b224fc4ff9b service swift] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:14.159996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3497e-2710-4414-8ef8-6b224fc4ff9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:14.168873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3497e-2710-4414-8ef8-6b224fc4ff9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:14.170448 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3497e-2710-4414-8ef8-6b224fc4ff9b service swift] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:14.178457 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1208/2453] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:11:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:11:24.115089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=9 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:24.175216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=12 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:28.293758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a87ef-ec1e-4435-98bd-8f3578bd0d8b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:28.362103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a87ef-ec1e-4435-98bd-8f3578bd0d8b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:28.367787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:28.368659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:28.368937 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:28.369215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] PATH_INFO: `/v3/users/d6aed5d4150446e484fc3d1484c147ee` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:28.370394 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6aed5d4150446e484fc3d1484c147ee)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:28.372351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:28.642656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6aed5d4150446e484fc3d1484c147ee'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:28.643323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6aed5d4150446e484fc3d1484c147ee'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:28.643954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6aed5d4150446e484fc3d1484c147ee'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:28.760660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6aed5d4150446e484fc3d1484c147ee'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:28.768085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6aed5d4150446e484fc3d1484c147ee'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:28.785262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1246/2454] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:11:28 2022] DELETE /identity/v3/users/d6aed5d4150446e484fc3d1484c147ee => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:11:28.789953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510933b-2bf5-4429-ab21-9374895766e7 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:28.790417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510933b-2bf5-4429-ab21-9374895766e7 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:28.790531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510933b-2bf5-4429-ab21-9374895766e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:28.808635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8510933b-2bf5-4429-ab21-9374895766e7 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:11:28.809837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8510933b-2bf5-4429-ab21-9374895766e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:28.869821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1209/2455] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:11:28.879412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:28.880777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:28.940625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e55508-bae5-46da-9762-cb087cb37459 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:28.947245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e4e14-ea58-453a-89d0-69f4a26391c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:28.947245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e4e14-ea58-453a-89d0-69f4a26391c2 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:28.947245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e4e14-ea58-453a-89d0-69f4a26391c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:28.947245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e4e14-ea58-453a-89d0-69f4a26391c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:28.954458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e4e14-ea58-453a-89d0-69f4a26391c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:28.955934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e4e14-ea58-453a-89d0-69f4a26391c2 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:28.965580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1247/2456] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:11:29.410679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510933b-2bf5-4429-ab21-9374895766e7 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:29.412297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8510933b-2bf5-4429-ab21-9374895766e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:29.426470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510933b-2bf5-4429-ab21-9374895766e7 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:29.431401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:29.432269 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:29.432553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:29.432839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] PATH_INFO: `/v3/projects/ab468c9840f34840a4a83911a515d8b4` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:29.434107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab468c9840f34840a4a83911a515d8b4)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:29.436166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:29.578745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab468c9840f34840a4a83911a515d8b4', 'request_id': 'req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:29.584290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab468c9840f34840a4a83911a515d8b4', 'request_id': 'req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:29.591763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab468c9840f34840a4a83911a515d8b4', 'request_id': 'req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:29.665647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] The token cache is being invalidate because project ab468c9840f34840a4a83911a515d8b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:11:29.665959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:29.666610 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:29.668216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1210/2457] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:11:29 2022] DELETE /identity/v3/projects/ab468c9840f34840a4a83911a515d8b4 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:11:38.961177 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:39.662322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:45.823642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e4e14-ea58-453a-89d0-69f4a26391c2 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:45.832117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e4e14-ea58-453a-89d0-69f4a26391c2 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:45.880266 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8624b-77e0-4407-8b4c-16e1057b4efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:45.880911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8624b-77e0-4407-8b4c-16e1057b4efd service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:45.881192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8624b-77e0-4407-8b4c-16e1057b4efd service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:45.881466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8624b-77e0-4407-8b4c-16e1057b4efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:45.883248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d4e8624b-77e0-4407-8b4c-16e1057b4efd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:45.945784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8624b-77e0-4407-8b4c-16e1057b4efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:45.947890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8624b-77e0-4407-8b4c-16e1057b4efd service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:45.957518 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1248/2458] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:11:49.593668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:49.595316 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:49.609697 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54ca61-acc6-4964-b2ba-6b4b3ad59f4e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:49.614319 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:49.615244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:49.615528 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:49.615810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] PATH_INFO: `/v3/users/f77a4ee31a9e48d18a3be08267eb6236` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:49.629823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77a4ee31a9e48d18a3be08267eb6236)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:49.631740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:49.810125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77a4ee31a9e48d18a3be08267eb6236'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:49.810919 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77a4ee31a9e48d18a3be08267eb6236'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:49.811563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77a4ee31a9e48d18a3be08267eb6236'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:49.818764 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77a4ee31a9e48d18a3be08267eb6236'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:49.832036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-a483dbe8-4ebc-408a-ad80-adab4e855489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77a4ee31a9e48d18a3be08267eb6236'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:49.940099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1211/2459] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:11:49 2022] DELETE /identity/v3/users/f77a4ee31a9e48d18a3be08267eb6236 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:11:50.195276 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8624b-77e0-4407-8b4c-16e1057b4efd service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:50.204516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8624b-77e0-4407-8b4c-16e1057b4efd service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:50.264975 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:50.265794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:50.266096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:50.266357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] PATH_INFO: `/v3/projects/9c30692586604d5b9b3a99913da0429a` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:50.277385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c30692586604d5b9b3a99913da0429a)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:50.279368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:50.389673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:50.393397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c30692586604d5b9b3a99913da0429a', 'request_id': 'req-2b532d43-2f0b-480b-be6b-64af7b14df1b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:50.398937 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c30692586604d5b9b3a99913da0429a', 'request_id': 'req-2b532d43-2f0b-480b-be6b-64af7b14df1b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:50.405860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c30692586604d5b9b3a99913da0429a', 'request_id': 'req-2b532d43-2f0b-480b-be6b-64af7b14df1b'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:50.516523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] The token cache is being invalidate because project 9c30692586604d5b9b3a99913da0429a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:11:50.516812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:50.517431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b532d43-2f0b-480b-be6b-64af7b14df1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:50.518998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1249/2460] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:11:50 2022] DELETE /identity/v3/projects/9c30692586604d5b9b3a99913da0429a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:11:50.524089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42d8fd-c7ca-46ba-a0fd-a6c55d96184f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:50.524486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42d8fd-c7ca-46ba-a0fd-a6c55d96184f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:50.524912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42d8fd-c7ca-46ba-a0fd-a6c55d96184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:50.543514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3b42d8fd-c7ca-46ba-a0fd-a6c55d96184f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:11:50.544696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3b42d8fd-c7ca-46ba-a0fd-a6c55d96184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:50.605811 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1212/2461] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:11:50.614036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed20b5-eb53-4d28-b2da-30d6380c8a32 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:50.614332 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed20b5-eb53-4d28-b2da-30d6380c8a32 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:50.614613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed20b5-eb53-4d28-b2da-30d6380c8a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:50.633304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-6eed20b5-eb53-4d28-b2da-30d6380c8a32 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:11:50.634866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6eed20b5-eb53-4d28-b2da-30d6380c8a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:50.642767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1250/2462] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:11:50.647046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42d8fd-c7ca-46ba-a0fd-a6c55d96184f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:50.658084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42d8fd-c7ca-46ba-a0fd-a6c55d96184f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:50.662670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f0c35-d938-41d0-9fa7-6b78b032c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:50.663356 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f0c35-d938-41d0-9fa7-6b78b032c96a admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:50.663744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f0c35-d938-41d0-9fa7-6b78b032c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:50.664035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f0c35-d938-41d0-9fa7-6b78b032c96a admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:50.666380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f0c35-d938-41d0-9fa7-6b78b032c96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:11:50.666380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f0c35-d938-41d0-9fa7-6b78b032c96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:50.667333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f0c35-d938-41d0-9fa7-6b78b032c96a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:50.686044 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1213/2463] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:11:50.690175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed20b5-eb53-4d28-b2da-30d6380c8a32 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:50.696938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed20b5-eb53-4d28-b2da-30d6380c8a32 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:50.701898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57baa0-57e4-48f5-aed9-3f46a9b5df62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:50.702585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57baa0-57e4-48f5-aed9-3f46a9b5df62 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:50.702870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57baa0-57e4-48f5-aed9-3f46a9b5df62 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:50.703185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57baa0-57e4-48f5-aed9-3f46a9b5df62 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:50.703899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57baa0-57e4-48f5-aed9-3f46a9b5df62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:50.705857 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57baa0-57e4-48f5-aed9-3f46a9b5df62 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:50.860408 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1251/2464] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:11:50 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:11:50.871533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f0c35-d938-41d0-9fa7-6b78b032c96a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:50.881426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f0c35-d938-41d0-9fa7-6b78b032c96a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:50.925216 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:50.937102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108e3ac-e988-484a-a973-878304d89c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:50.937766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108e3ac-e988-484a-a973-878304d89c97 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:50.938049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108e3ac-e988-484a-a973-878304d89c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:50.938322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108e3ac-e988-484a-a973-878304d89c97 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:50.939037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108e3ac-e988-484a-a973-878304d89c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:50.940955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108e3ac-e988-484a-a973-878304d89c97 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:51.032169 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1214/2465] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:11:50 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:11:51.036472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57baa0-57e4-48f5-aed9-3f46a9b5df62 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:51.047674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57baa0-57e4-48f5-aed9-3f46a9b5df62 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:51.052343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c53160-61c2-423d-bfe7-4c76fc783e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:51.053002 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c53160-61c2-423d-bfe7-4c76fc783e64 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:51.053292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c53160-61c2-423d-bfe7-4c76fc783e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:51.053568 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c53160-61c2-423d-bfe7-4c76fc783e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:51.054291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c53160-61c2-423d-bfe7-4c76fc783e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:51.056538 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c53160-61c2-423d-bfe7-4c76fc783e64 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:51.066342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1252/2466] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:11:51.070201 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108e3ac-e988-484a-a973-878304d89c97 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:51.080582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108e3ac-e988-484a-a973-878304d89c97 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:51.085159 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b566431-32c9-40fa-bec2-78875aa85a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:51.091588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566431-32c9-40fa-bec2-78875aa85a87 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:51.091588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566431-32c9-40fa-bec2-78875aa85a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:51.091588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566431-32c9-40fa-bec2-78875aa85a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:51.091588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b566431-32c9-40fa-bec2-78875aa85a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:51.091950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b566431-32c9-40fa-bec2-78875aa85a87 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:51.102187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1215/2467] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:11:51.106954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c53160-61c2-423d-bfe7-4c76fc783e64 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:51.117133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c53160-61c2-423d-bfe7-4c76fc783e64 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:51.121801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e493b8-781e-4668-bc5f-b05ceca0af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:51.122672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e493b8-781e-4668-bc5f-b05ceca0af67 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:51.122955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e493b8-781e-4668-bc5f-b05ceca0af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:51.123292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e493b8-781e-4668-bc5f-b05ceca0af67 admin admin] PATH_INFO: `/v3/projects/6997997794b642c699d82a280fc31c3b/users/6e8e183bb427489db8ef3764ded4e4ff/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:51.138446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e493b8-781e-4668-bc5f-b05ceca0af67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6997997794b642c699d82a280fc31c3b, user_id=6e8e183bb427489db8ef3764ded4e4ff, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:51.141362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e493b8-781e-4668-bc5f-b05ceca0af67 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:51.225925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1253/2468] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:11:51 2022] PUT /identity/v3/projects/6997997794b642c699d82a280fc31c3b/users/6e8e183bb427489db8ef3764ded4e4ff/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:11:51.237126 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6248-662e-4f53-b634-24bb5db7951a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:51.237417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6248-662e-4f53-b634-24bb5db7951a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:51.237696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6248-662e-4f53-b634-24bb5db7951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:51.263577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-d00f6248-662e-4f53-b634-24bb5db7951a None None] MFA Rules not processed for user `6e8e183bb427489db8ef3764ded4e4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:11:51.264783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d00f6248-662e-4f53-b634-24bb5db7951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:51.328372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1216/2469] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:11:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:11:51.341087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e493b8-781e-4668-bc5f-b05ceca0af67 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:51.342694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a4e493b8-781e-4668-bc5f-b05ceca0af67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:51.416143 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e493b8-781e-4668-bc5f-b05ceca0af67 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:51.421787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9f2cb-5776-4990-a9d9-ce8575257e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:51.422555 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9f2cb-5776-4990-a9d9-ce8575257e0b service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:51.422843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9f2cb-5776-4990-a9d9-ce8575257e0b service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:51.423150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9f2cb-5776-4990-a9d9-ce8575257e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:51.431325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9f2cb-5776-4990-a9d9-ce8575257e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:51.432957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9f2cb-5776-4990-a9d9-ce8575257e0b service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:51.441798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1254/2470] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:11:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:11:51.648766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6248-662e-4f53-b634-24bb5db7951a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:51.715087 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6248-662e-4f53-b634-24bb5db7951a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:51.719714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:51.720578 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:51.720866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:51.721143 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] PATH_INFO: `/v3/users/6e8e183bb427489db8ef3764ded4e4ff` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:51.722331 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8e183bb427489db8ef3764ded4e4ff)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:51.724290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:51.887446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8e183bb427489db8ef3764ded4e4ff'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:51.888138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8e183bb427489db8ef3764ded4e4ff'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:51.888742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8e183bb427489db8ef3764ded4e4ff'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:51.895476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8e183bb427489db8ef3764ded4e4ff'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:51.897376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:51.908581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8e183bb427489db8ef3764ded4e4ff'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:51.983788 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1217/2471] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:11:51 2022] DELETE /identity/v3/users/6e8e183bb427489db8ef3764ded4e4ff => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:11:51.988275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb125d-80e1-4878-ad36-13b2c2355120 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:51.988568 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb125d-80e1-4878-ad36-13b2c2355120 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:51.988850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb125d-80e1-4878-ad36-13b2c2355120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:52.005918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-fadb125d-80e1-4878-ad36-13b2c2355120 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:11:52.007234 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-fadb125d-80e1-4878-ad36-13b2c2355120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:52.055567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:52.066975 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1255/2472] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:11:52.080034 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:52.081431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:52.141249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7fe57-0ab2-4bbc-9e21-0eeb8cff2f20 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:52.144891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ee7ab-b72e-4d28-aaa2-8bcfa7787984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:52.145539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ee7ab-b72e-4d28-aaa2-8bcfa7787984 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:52.145820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ee7ab-b72e-4d28-aaa2-8bcfa7787984 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:52.146096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ee7ab-b72e-4d28-aaa2-8bcfa7787984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:52.156092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ee7ab-b72e-4d28-aaa2-8bcfa7787984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:52.157533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ee7ab-b72e-4d28-aaa2-8bcfa7787984 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:52.167052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1218/2473] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:11:52.652237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb125d-80e1-4878-ad36-13b2c2355120 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:52.653005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-fadb125d-80e1-4878-ad36-13b2c2355120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:52.670371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb125d-80e1-4878-ad36-13b2c2355120 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:52.686954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:52.686954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:52.686954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:52.686954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] PATH_INFO: `/v3/projects/6997997794b642c699d82a280fc31c3b` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:52.687519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6997997794b642c699d82a280fc31c3b)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:52.687519 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:52.838369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6997997794b642c699d82a280fc31c3b', 'request_id': 'req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:52.844249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6997997794b642c699d82a280fc31c3b', 'request_id': 'req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:52.850422 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6997997794b642c699d82a280fc31c3b', 'request_id': 'req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:52.951801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] The token cache is being invalidate because project 6997997794b642c699d82a280fc31c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:11:52.952016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:52.952660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b7bef4fe-1c13-456d-b6cb-c7c858af9b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:11:52.954241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1256/2474] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:11:52 2022] DELETE /identity/v3/projects/6997997794b642c699d82a280fc31c3b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:11:52.959089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074d5ad-ece2-46f1-bdcd-35335a4851ec None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:52.961162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074d5ad-ece2-46f1-bdcd-35335a4851ec None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:52.961162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074d5ad-ece2-46f1-bdcd-35335a4851ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:52.977840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-d074d5ad-ece2-46f1-bdcd-35335a4851ec None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:11:52.979088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d074d5ad-ece2-46f1-bdcd-35335a4851ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:53.036376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1219/2475] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:11:53.044602 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b38a-a94b-4df6-bd65-cb748a5ccf11 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:53.044892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b38a-a94b-4df6-bd65-cb748a5ccf11 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:53.045170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b38a-a94b-4df6-bd65-cb748a5ccf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:53.064112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-9ca6b38a-a94b-4df6-bd65-cb748a5ccf11 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:11:53.065290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9ca6b38a-a94b-4df6-bd65-cb748a5ccf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:53.073369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1257/2476] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:11:53.077455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074d5ad-ece2-46f1-bdcd-35335a4851ec None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:53.087218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074d5ad-ece2-46f1-bdcd-35335a4851ec None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:53.092106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb4a94-f6d6-458a-aa10-f46f43369d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:53.092751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4a94-f6d6-458a-aa10-f46f43369d74 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:53.093028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4a94-f6d6-458a-aa10-f46f43369d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:53.093302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb4a94-f6d6-458a-aa10-f46f43369d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:53.094025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb4a94-f6d6-458a-aa10-f46f43369d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:11:53.094423 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb4a94-f6d6-458a-aa10-f46f43369d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:53.096074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb4a94-f6d6-458a-aa10-f46f43369d74 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:53.107951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1220/2477] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:11:53.112069 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6b38a-a94b-4df6-bd65-cb748a5ccf11 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:53.122170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6b38a-a94b-4df6-bd65-cb748a5ccf11 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:53.126809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58e220-3029-4dab-9aeb-2e0f60664c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:53.127502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58e220-3029-4dab-9aeb-2e0f60664c51 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:53.127785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58e220-3029-4dab-9aeb-2e0f60664c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:53.128058 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58e220-3029-4dab-9aeb-2e0f60664c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:53.128733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58e220-3029-4dab-9aeb-2e0f60664c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:53.130619 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58e220-3029-4dab-9aeb-2e0f60664c51 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:53.256259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1258/2478] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:11:53 2022] POST /identity/v3/projects => generated 355 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:11:53.260253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb4a94-f6d6-458a-aa10-f46f43369d74 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:53.270368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb4a94-f6d6-458a-aa10-f46f43369d74 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:53.325450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baf3f8-ff9e-44d1-a78a-3bcf5338b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:53.326110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baf3f8-ff9e-44d1-a78a-3bcf5338b350 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:53.326394 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baf3f8-ff9e-44d1-a78a-3bcf5338b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:53.326668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baf3f8-ff9e-44d1-a78a-3bcf5338b350 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:53.327405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baf3f8-ff9e-44d1-a78a-3bcf5338b350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:53.329332 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1baf3f8-ff9e-44d1-a78a-3bcf5338b350 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:53.339791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:53.452068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1221/2479] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:11:53 2022] POST /identity/v3/users => generated 278 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:11:53.456013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58e220-3029-4dab-9aeb-2e0f60664c51 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:53.467020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58e220-3029-4dab-9aeb-2e0f60664c51 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:53.471548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e340c-416f-4bc3-ad5d-65ecb8670521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:53.472201 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e340c-416f-4bc3-ad5d-65ecb8670521 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:53.472485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e340c-416f-4bc3-ad5d-65ecb8670521 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:53.472759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e340c-416f-4bc3-ad5d-65ecb8670521 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:53.473477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e340c-416f-4bc3-ad5d-65ecb8670521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:53.475119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e340c-416f-4bc3-ad5d-65ecb8670521 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:53.487252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1259/2480] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:11:53.491204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baf3f8-ff9e-44d1-a78a-3bcf5338b350 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:53.501213 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baf3f8-ff9e-44d1-a78a-3bcf5338b350 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:53.505821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63007339-6246-4fa0-845b-0d6251bc994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:53.506524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007339-6246-4fa0-845b-0d6251bc994b admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:53.506758 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007339-6246-4fa0-845b-0d6251bc994b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:53.507077 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63007339-6246-4fa0-845b-0d6251bc994b admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:53.507875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63007339-6246-4fa0-845b-0d6251bc994b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:53.509502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63007339-6246-4fa0-845b-0d6251bc994b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:53.520387 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1222/2481] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:11:53.524984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e340c-416f-4bc3-ad5d-65ecb8670521 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:53.534993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e340c-416f-4bc3-ad5d-65ecb8670521 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:53.539539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc4ab3-64fa-44f4-946b-035c03110309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:53.541133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc4ab3-64fa-44f4-946b-035c03110309 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:53.541414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc4ab3-64fa-44f4-946b-035c03110309 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:53.541681 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc4ab3-64fa-44f4-946b-035c03110309 admin admin] PATH_INFO: `/v3/projects/487aac355bb6465982a8205645a74bee/users/d91244349e7f49ea8d1ad9e54704f5c3/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:53.556288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc4ab3-64fa-44f4-946b-035c03110309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487aac355bb6465982a8205645a74bee, user_id=d91244349e7f49ea8d1ad9e54704f5c3, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:53.558977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc4ab3-64fa-44f4-946b-035c03110309 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:53.629354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1260/2482] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:11:53 2022] PUT /identity/v3/projects/487aac355bb6465982a8205645a74bee/users/d91244349e7f49ea8d1ad9e54704f5c3/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:11:53.641653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251793-4522-44c1-bcc6-7564d4ef65a1 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:53.642062 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251793-4522-44c1-bcc6-7564d4ef65a1 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:53.642446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251793-4522-44c1-bcc6-7564d4ef65a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:53.669946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f8251793-4522-44c1-bcc6-7564d4ef65a1 None None] MFA Rules not processed for user `d91244349e7f49ea8d1ad9e54704f5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:11:53.671215 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f8251793-4522-44c1-bcc6-7564d4ef65a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:53.735064 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1223/2483] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:11:53.739448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc4ab3-64fa-44f4-946b-035c03110309 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:53.801061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc4ab3-64fa-44f4-946b-035c03110309 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:53.805626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c74387-fba4-4d2e-acac-6a857151f149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:53.806270 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74387-fba4-4d2e-acac-6a857151f149 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:53.806546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74387-fba4-4d2e-acac-6a857151f149 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:53.806815 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74387-fba4-4d2e-acac-6a857151f149 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:53.807527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c74387-fba4-4d2e-acac-6a857151f149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:53.809420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c74387-fba4-4d2e-acac-6a857151f149 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:53.880891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:53.888582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1261/2484] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:11:53 2022] POST /identity/v3/projects => generated 357 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:11:53.892787 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8251793-4522-44c1-bcc6-7564d4ef65a1 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:53.904451 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8251793-4522-44c1-bcc6-7564d4ef65a1 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:53.961336 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7013e-dfc2-45eb-9244-e2d86785d2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:53.962199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7013e-dfc2-45eb-9244-e2d86785d2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:53.962347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7013e-dfc2-45eb-9244-e2d86785d2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:53.962626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7013e-dfc2-45eb-9244-e2d86785d2c3 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:53.963339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7013e-dfc2-45eb-9244-e2d86785d2c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:53.965572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7013e-dfc2-45eb-9244-e2d86785d2c3 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:54.052629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1224/2485] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:11:53 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:11:54.057645 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c74387-fba4-4d2e-acac-6a857151f149 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:54.067523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c74387-fba4-4d2e-acac-6a857151f149 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:54.072477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5fe5a-ea6e-4617-9e80-c9241adc2ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:54.073133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5fe5a-ea6e-4617-9e80-c9241adc2ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:54.073983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5fe5a-ea6e-4617-9e80-c9241adc2ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:54.074262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5fe5a-ea6e-4617-9e80-c9241adc2ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:54.074999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5fe5a-ea6e-4617-9e80-c9241adc2ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:54.076627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5fe5a-ea6e-4617-9e80-c9241adc2ec7 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:54.090361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1262/2486] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:11:54.091534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7013e-dfc2-45eb-9244-e2d86785d2c3 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:54.101753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7013e-dfc2-45eb-9244-e2d86785d2c3 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:54.106442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caf9b4-54b2-4bd2-982c-122c58030363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:54.107345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caf9b4-54b2-4bd2-982c-122c58030363 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:54.107627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caf9b4-54b2-4bd2-982c-122c58030363 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:54.107903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caf9b4-54b2-4bd2-982c-122c58030363 admin admin] PATH_INFO: `/v3/projects/6b5ba3752ed8454799799eaa3d359ce2/users/e03f1864ae2b4503add8de13f6dbc58a/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:54.122918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6caf9b4-54b2-4bd2-982c-122c58030363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5ba3752ed8454799799eaa3d359ce2, user_id=e03f1864ae2b4503add8de13f6dbc58a, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:54.125604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6caf9b4-54b2-4bd2-982c-122c58030363 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:54.218472 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1225/2487] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:11:54 2022] PUT /identity/v3/projects/6b5ba3752ed8454799799eaa3d359ce2/users/e03f1864ae2b4503add8de13f6dbc58a/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:11:54.222607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5fe5a-ea6e-4617-9e80-c9241adc2ec7 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:54.233155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5fe5a-ea6e-4617-9e80-c9241adc2ec7 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:54.289065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0385f-ca71-47ea-a2c9-5dead99d4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:54.290352 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0385f-ca71-47ea-a2c9-5dead99d4c7e admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:54.290791 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0385f-ca71-47ea-a2c9-5dead99d4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:54.291094 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0385f-ca71-47ea-a2c9-5dead99d4c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:54.291809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0385f-ca71-47ea-a2c9-5dead99d4c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:54.293391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0385f-ca71-47ea-a2c9-5dead99d4c7e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:54.304821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1263/2488] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:11:54.307123 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caf9b4-54b2-4bd2-982c-122c58030363 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:54.317645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caf9b4-54b2-4bd2-982c-122c58030363 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:54.323063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183e67-837e-4d40-b8b6-c2a490bf900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:54.323939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183e67-837e-4d40-b8b6-c2a490bf900d admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:54.324223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183e67-837e-4d40-b8b6-c2a490bf900d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:54.324500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1183e67-837e-4d40-b8b6-c2a490bf900d admin admin] PATH_INFO: `/v3/projects/6b5ba3752ed8454799799eaa3d359ce2/users/e03f1864ae2b4503add8de13f6dbc58a/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:54.326462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1183e67-837e-4d40-b8b6-c2a490bf900d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5ba3752ed8454799799eaa3d359ce2, user_id=e03f1864ae2b4503add8de13f6dbc58a, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:54.329205 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1183e67-837e-4d40-b8b6-c2a490bf900d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:54.340413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1226/2489] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:11:54 2022] PUT /identity/v3/projects/6b5ba3752ed8454799799eaa3d359ce2/users/e03f1864ae2b4503add8de13f6dbc58a/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:11:54.350413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51754d5f-4d7c-4922-ba4c-355df8a1867c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:54.350701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51754d5f-4d7c-4922-ba4c-355df8a1867c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:54.351001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51754d5f-4d7c-4922-ba4c-355df8a1867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:54.376592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-51754d5f-4d7c-4922-ba4c-355df8a1867c None None] MFA Rules not processed for user `e03f1864ae2b4503add8de13f6dbc58a`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:11:54.382241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-51754d5f-4d7c-4922-ba4c-355df8a1867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:54.444891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1264/2490] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:11:54.456885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183e67-837e-4d40-b8b6-c2a490bf900d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:54.458561 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b1183e67-837e-4d40-b8b6-c2a490bf900d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:11:54.489912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:11:54.517090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1183e67-837e-4d40-b8b6-c2a490bf900d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:54.520790 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71d9de-7688-4539-ac6f-4786ec31fa4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:54.521454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71d9de-7688-4539-ac6f-4786ec31fa4e service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:54.521734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71d9de-7688-4539-ac6f-4786ec31fa4e service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:54.522010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb71d9de-7688-4539-ac6f-4786ec31fa4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:54.533516 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71d9de-7688-4539-ac6f-4786ec31fa4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:54.534956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb71d9de-7688-4539-ac6f-4786ec31fa4e service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:54.544621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1227/2491] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:11:54 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:11:54.809573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51754d5f-4d7c-4922-ba4c-355df8a1867c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:11:54.819319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51754d5f-4d7c-4922-ba4c-355df8a1867c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:11:54.823743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1970da-a854-41cd-af8d-a9230fabbb3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:11:54.824450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1970da-a854-41cd-af8d-a9230fabbb3e service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:11:54.824717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1970da-a854-41cd-af8d-a9230fabbb3e service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:11:54.825023 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1970da-a854-41cd-af8d-a9230fabbb3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:11:54.880826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1970da-a854-41cd-af8d-a9230fabbb3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:11:54.882290 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1970da-a854-41cd-af8d-a9230fabbb3e service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:11:54.891637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1265/2492] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:11:54 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:12:04.566111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=14 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:04.887779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:08.363538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71d9de-7688-4539-ac6f-4786ec31fa4e service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:08.365004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fb71d9de-7688-4539-ac6f-4786ec31fa4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:08.423730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb71d9de-7688-4539-ac6f-4786ec31fa4e service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:08.427503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9028999-2dad-44ca-ad8e-af111b758779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:08.428150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9028999-2dad-44ca-ad8e-af111b758779 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:08.428434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9028999-2dad-44ca-ad8e-af111b758779 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:08.428712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9028999-2dad-44ca-ad8e-af111b758779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:08.430520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b9028999-2dad-44ca-ad8e-af111b758779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:08.440567 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9028999-2dad-44ca-ad8e-af111b758779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:08.442010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9028999-2dad-44ca-ad8e-af111b758779 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:08.450130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1228/2493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:09.561153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1970da-a854-41cd-af8d-a9230fabbb3e service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:09.562605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8c1970da-a854-41cd-af8d-a9230fabbb3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:09.637448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1970da-a854-41cd-af8d-a9230fabbb3e service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:09.643027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090616c-1370-4414-98c8-10f29c5ee1a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:09.643688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090616c-1370-4414-98c8-10f29c5ee1a3 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:09.644004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090616c-1370-4414-98c8-10f29c5ee1a3 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:09.644314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090616c-1370-4414-98c8-10f29c5ee1a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:09.646107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a090616c-1370-4414-98c8-10f29c5ee1a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:09.727211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090616c-1370-4414-98c8-10f29c5ee1a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:09.729412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090616c-1370-4414-98c8-10f29c5ee1a3 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:09.751846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1266/2494] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:15.002753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9028999-2dad-44ca-ad8e-af111b758779 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:15.065728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9028999-2dad-44ca-ad8e-af111b758779 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:15.071624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:15.072499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:15.072781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:15.073061 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] PATH_INFO: `/v3/users/d91244349e7f49ea8d1ad9e54704f5c3` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:15.074281 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91244349e7f49ea8d1ad9e54704f5c3)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:15.076362 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:15.351827 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91244349e7f49ea8d1ad9e54704f5c3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:15.352420 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91244349e7f49ea8d1ad9e54704f5c3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:15.353024 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91244349e7f49ea8d1ad9e54704f5c3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:15.360495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91244349e7f49ea8d1ad9e54704f5c3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:15.373779 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91244349e7f49ea8d1ad9e54704f5c3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:15.452127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1229/2495] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:15 2022] DELETE /identity/v3/users/d91244349e7f49ea8d1ad9e54704f5c3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:15.456715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e6f8-8ab8-4533-8d10-f6e61de1225d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:15.457223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e6f8-8ab8-4533-8d10-f6e61de1225d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:15.457347 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3e6f8-8ab8-4533-8d10-f6e61de1225d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:15.477888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-01a3e6f8-8ab8-4533-8d10-f6e61de1225d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:15.479217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-01a3e6f8-8ab8-4533-8d10-f6e61de1225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:15.543913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1267/2496] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:15.554064 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:15.556138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:15.587089 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:15.622546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b7fef-f7bb-43a3-b63e-4e1b1dfbaf19 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:15.626203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116693-0dcc-4795-bb46-7af9c33cc7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:15.626849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116693-0dcc-4795-bb46-7af9c33cc7ee service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:15.627162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116693-0dcc-4795-bb46-7af9c33cc7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:15.627441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f116693-0dcc-4795-bb46-7af9c33cc7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:15.637464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f116693-0dcc-4795-bb46-7af9c33cc7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:15.639004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f116693-0dcc-4795-bb46-7af9c33cc7ee service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:15.650027 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1230/2497] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:16.094331 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3e6f8-8ab8-4533-8d10-f6e61de1225d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:16.097008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-01a3e6f8-8ab8-4533-8d10-f6e61de1225d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:16.108771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3e6f8-8ab8-4533-8d10-f6e61de1225d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:16.113765 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:16.114718 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:16.114919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:16.115265 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] PATH_INFO: `/v3/projects/487aac355bb6465982a8205645a74bee` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:16.116482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=487aac355bb6465982a8205645a74bee)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:16.118421 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:16.121907 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:16.282494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487aac355bb6465982a8205645a74bee', 'request_id': 'req-fe1a701a-096f-4c70-9eaa-cb5ba1345685'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:16.288152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487aac355bb6465982a8205645a74bee', 'request_id': 'req-fe1a701a-096f-4c70-9eaa-cb5ba1345685'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:16.295753 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487aac355bb6465982a8205645a74bee', 'request_id': 'req-fe1a701a-096f-4c70-9eaa-cb5ba1345685'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:16.377739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] The token cache is being invalidate because project 487aac355bb6465982a8205645a74bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:16.378030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:16.378695 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:16.380299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1268/2498] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:16 2022] DELETE /identity/v3/projects/487aac355bb6465982a8205645a74bee => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:16.384299 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116693-0dcc-4795-bb46-7af9c33cc7ee service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:16.394229 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f116693-0dcc-4795-bb46-7af9c33cc7ee service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:16.450485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:16.451300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:16.451583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:16.451860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] PATH_INFO: `/v3/users/e03f1864ae2b4503add8de13f6dbc58a` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:16.453039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03f1864ae2b4503add8de13f6dbc58a)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:16.455287 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:16.660968 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03f1864ae2b4503add8de13f6dbc58a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:16.661617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03f1864ae2b4503add8de13f6dbc58a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:16.662215 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03f1864ae2b4503add8de13f6dbc58a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:16.669886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03f1864ae2b4503add8de13f6dbc58a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:16.682526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-43d7363e-e635-4e52-b0bb-52168bc8e6c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03f1864ae2b4503add8de13f6dbc58a'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:16.745648 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1231/2499] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:16 2022] DELETE /identity/v3/users/e03f1864ae2b4503add8de13f6dbc58a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:17.236590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:17.238159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:17.255678 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a701a-096f-4c70-9eaa-cb5ba1345685 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:17.313292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:17.314178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:17.314462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:17.314741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] PATH_INFO: `/v3/projects/6b5ba3752ed8454799799eaa3d359ce2` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:17.316020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5ba3752ed8454799799eaa3d359ce2)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:17.317943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:17.440122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5ba3752ed8454799799eaa3d359ce2', 'request_id': 'req-2dc83d77-8356-4f9d-b801-5e1547f78cee'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:17.445666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5ba3752ed8454799799eaa3d359ce2', 'request_id': 'req-2dc83d77-8356-4f9d-b801-5e1547f78cee'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:17.452774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5ba3752ed8454799799eaa3d359ce2', 'request_id': 'req-2dc83d77-8356-4f9d-b801-5e1547f78cee'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:17.548278 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] The token cache is being invalidate because project 6b5ba3752ed8454799799eaa3d359ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:17.548568 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:17.549213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2dc83d77-8356-4f9d-b801-5e1547f78cee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:17.550789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1269/2500] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:17 2022] DELETE /identity/v3/projects/6b5ba3752ed8454799799eaa3d359ce2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:17.555806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774f65d-47ce-4266-a598-2164e55cde53 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:17.556309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774f65d-47ce-4266-a598-2164e55cde53 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:17.556414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774f65d-47ce-4266-a598-2164e55cde53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:17.575164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-3774f65d-47ce-4266-a598-2164e55cde53 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:17.576325 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3774f65d-47ce-4266-a598-2164e55cde53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:17.616652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:17.636994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1232/2501] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:17.645848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7e817-0ccd-4c84-bf5a-88cb17ff5b78 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:17.646158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7e817-0ccd-4c84-bf5a-88cb17ff5b78 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:17.646467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7e817-0ccd-4c84-bf5a-88cb17ff5b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:17.664925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-10a7e817-0ccd-4c84-bf5a-88cb17ff5b78 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:17.666119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-10a7e817-0ccd-4c84-bf5a-88cb17ff5b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:17.676944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1270/2502] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:17.680029 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774f65d-47ce-4266-a598-2164e55cde53 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:17.690486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774f65d-47ce-4266-a598-2164e55cde53 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:17.695220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828992d-41df-47cb-99e6-384cf8c7775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:17.695874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828992d-41df-47cb-99e6-384cf8c7775a admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:17.696165 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828992d-41df-47cb-99e6-384cf8c7775a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:17.696466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828992d-41df-47cb-99e6-384cf8c7775a admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:17.697193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828992d-41df-47cb-99e6-384cf8c7775a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:12:17.697499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828992d-41df-47cb-99e6-384cf8c7775a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:17.699439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828992d-41df-47cb-99e6-384cf8c7775a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:17.711576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1233/2503] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:12:17.716157 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7e817-0ccd-4c84-bf5a-88cb17ff5b78 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:17.725289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7e817-0ccd-4c84-bf5a-88cb17ff5b78 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:17.730850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad990c3-bd7a-4cc0-816a-54c289cecc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:17.732008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad990c3-bd7a-4cc0-816a-54c289cecc43 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:17.732461 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad990c3-bd7a-4cc0-816a-54c289cecc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:17.732750 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad990c3-bd7a-4cc0-816a-54c289cecc43 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:17.733462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad990c3-bd7a-4cc0-816a-54c289cecc43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:17.735710 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad990c3-bd7a-4cc0-816a-54c289cecc43 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:17.750015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:17.856424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1271/2504] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:17 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:17.860620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828992d-41df-47cb-99e6-384cf8c7775a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:17.871938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828992d-41df-47cb-99e6-384cf8c7775a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:17.930817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2682b0-acb1-41e5-88bb-3eb10c5ae68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:17.931533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2682b0-acb1-41e5-88bb-3eb10c5ae68a admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:17.931814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2682b0-acb1-41e5-88bb-3eb10c5ae68a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:17.932088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2682b0-acb1-41e5-88bb-3eb10c5ae68a admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:17.932940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2682b0-acb1-41e5-88bb-3eb10c5ae68a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:17.935082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2682b0-acb1-41e5-88bb-3eb10c5ae68a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:18.050252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1234/2505] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:17 2022] POST /identity/v3/users => generated 282 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:18.054241 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad990c3-bd7a-4cc0-816a-54c289cecc43 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:18.064531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad990c3-bd7a-4cc0-816a-54c289cecc43 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:18.069129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fde56-8a7c-4f2e-845c-c5a6bc9ef78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:18.069780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fde56-8a7c-4f2e-845c-c5a6bc9ef78b admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:18.070067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fde56-8a7c-4f2e-845c-c5a6bc9ef78b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:18.070344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fde56-8a7c-4f2e-845c-c5a6bc9ef78b admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:18.071093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fde56-8a7c-4f2e-845c-c5a6bc9ef78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:18.072768 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fde56-8a7c-4f2e-845c-c5a6bc9ef78b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:18.083310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1272/2506] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:18.087138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2682b0-acb1-41e5-88bb-3eb10c5ae68a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:18.097952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2682b0-acb1-41e5-88bb-3eb10c5ae68a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:18.103181 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766202be-9e93-4203-a59b-13a7f2a89e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:18.103832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766202be-9e93-4203-a59b-13a7f2a89e70 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:18.104115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766202be-9e93-4203-a59b-13a7f2a89e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:18.104388 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766202be-9e93-4203-a59b-13a7f2a89e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:18.106419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766202be-9e93-4203-a59b-13a7f2a89e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:18.108098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766202be-9e93-4203-a59b-13a7f2a89e70 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:18.118255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1235/2507] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:12:18.122493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fde56-8a7c-4f2e-845c-c5a6bc9ef78b admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:18.132227 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fde56-8a7c-4f2e-845c-c5a6bc9ef78b admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:18.139434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba26e0-1755-4b20-b829-42d0b48b3649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:18.139434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba26e0-1755-4b20-b829-42d0b48b3649 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:18.139434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba26e0-1755-4b20-b829-42d0b48b3649 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:18.139434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba26e0-1755-4b20-b829-42d0b48b3649 admin admin] PATH_INFO: `/v3/projects/3dab76c2889c45f0a25d7b96e2c0d047/users/b4adf34dbef5402ea68dec7be5bca7be/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:18.154476 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba26e0-1755-4b20-b829-42d0b48b3649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dab76c2889c45f0a25d7b96e2c0d047, user_id=b4adf34dbef5402ea68dec7be5bca7be, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:18.157243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba26e0-1755-4b20-b829-42d0b48b3649 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:18.278735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1273/2508] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:18 2022] PUT /identity/v3/projects/3dab76c2889c45f0a25d7b96e2c0d047/users/b4adf34dbef5402ea68dec7be5bca7be/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:18.288859 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af340-7ad8-4f88-bdc2-42640381e412 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:18.289156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af340-7ad8-4f88-bdc2-42640381e412 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:18.289437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6af340-7ad8-4f88-bdc2-42640381e412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:18.316250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-5f6af340-7ad8-4f88-bdc2-42640381e412 None None] MFA Rules not processed for user `b4adf34dbef5402ea68dec7be5bca7be`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:18.317461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5f6af340-7ad8-4f88-bdc2-42640381e412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:18.380829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1236/2509] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:18.385208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba26e0-1755-4b20-b829-42d0b48b3649 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:18.447092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba26e0-1755-4b20-b829-42d0b48b3649 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:18.452475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15ca22-d76c-4be2-b7f3-22e112038a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:18.453134 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ca22-d76c-4be2-b7f3-22e112038a58 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:18.453418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ca22-d76c-4be2-b7f3-22e112038a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:18.453694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15ca22-d76c-4be2-b7f3-22e112038a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:18.454390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15ca22-d76c-4be2-b7f3-22e112038a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:18.456360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15ca22-d76c-4be2-b7f3-22e112038a58 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:18.550229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1274/2510] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:18 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:18.554204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6af340-7ad8-4f88-bdc2-42640381e412 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:18.565553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6af340-7ad8-4f88-bdc2-42640381e412 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:18.605239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:18.624203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b26cb-e906-4b6c-8821-dcf37a9bb17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:18.624876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b26cb-e906-4b6c-8821-dcf37a9bb17b admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:18.625162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b26cb-e906-4b6c-8821-dcf37a9bb17b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:18.625441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b26cb-e906-4b6c-8821-dcf37a9bb17b admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:18.626129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b26cb-e906-4b6c-8821-dcf37a9bb17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:18.628094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b26cb-e906-4b6c-8821-dcf37a9bb17b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:18.712185 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1237/2511] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:18 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:18.716575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15ca22-d76c-4be2-b7f3-22e112038a58 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:18.726923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15ca22-d76c-4be2-b7f3-22e112038a58 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:18.731957 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47910990-7d0b-4f8e-a928-d68aa4bbf140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:18.737726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47910990-7d0b-4f8e-a928-d68aa4bbf140 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:18.737726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47910990-7d0b-4f8e-a928-d68aa4bbf140 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:18.737726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47910990-7d0b-4f8e-a928-d68aa4bbf140 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:18.737726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47910990-7d0b-4f8e-a928-d68aa4bbf140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:18.737726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47910990-7d0b-4f8e-a928-d68aa4bbf140 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:18.746635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1275/2512] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:18.750902 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b26cb-e906-4b6c-8821-dcf37a9bb17b admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:18.762407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b26cb-e906-4b6c-8821-dcf37a9bb17b admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:18.767351 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd81b5-6d30-4d28-80ee-725e251828b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:18.768223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd81b5-6d30-4d28-80ee-725e251828b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:18.768503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd81b5-6d30-4d28-80ee-725e251828b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:18.768773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd81b5-6d30-4d28-80ee-725e251828b4 admin admin] PATH_INFO: `/v3/projects/3ff6a79ab3db49b4a323197ac5808b16/users/762db2415b2a479487c485c582d92c76/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:18.783867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd81b5-6d30-4d28-80ee-725e251828b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff6a79ab3db49b4a323197ac5808b16, user_id=762db2415b2a479487c485c582d92c76, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:18.786533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd81b5-6d30-4d28-80ee-725e251828b4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:18.892503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1238/2513] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:18 2022] PUT /identity/v3/projects/3ff6a79ab3db49b4a323197ac5808b16/users/762db2415b2a479487c485c582d92c76/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:18.896418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47910990-7d0b-4f8e-a928-d68aa4bbf140 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:18.906912 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47910990-7d0b-4f8e-a928-d68aa4bbf140 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:18.962161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d45ce-f79d-419d-a753-112bc2956876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:18.962749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d45ce-f79d-419d-a753-112bc2956876 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:18.963064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d45ce-f79d-419d-a753-112bc2956876 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:18.963341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d45ce-f79d-419d-a753-112bc2956876 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:18.964341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d45ce-f79d-419d-a753-112bc2956876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:18.966001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d45ce-f79d-419d-a753-112bc2956876 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:18.975532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1276/2514] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:18.979606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd81b5-6d30-4d28-80ee-725e251828b4 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:18.991019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd81b5-6d30-4d28-80ee-725e251828b4 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:18.996180 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc0889-82ac-4636-aaf0-786f8e648f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:18.997117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc0889-82ac-4636-aaf0-786f8e648f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:18.997396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc0889-82ac-4636-aaf0-786f8e648f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:18.997669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc0889-82ac-4636-aaf0-786f8e648f4d admin admin] PATH_INFO: `/v3/projects/3ff6a79ab3db49b4a323197ac5808b16/users/762db2415b2a479487c485c582d92c76/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:18.999672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc0889-82ac-4636-aaf0-786f8e648f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff6a79ab3db49b4a323197ac5808b16, user_id=762db2415b2a479487c485c582d92c76, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:19.002296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc0889-82ac-4636-aaf0-786f8e648f4d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:19.013022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1239/2515] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:18 2022] PUT /identity/v3/projects/3ff6a79ab3db49b4a323197ac5808b16/users/762db2415b2a479487c485c582d92c76/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:19.022993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1ad8-7f02-4621-977c-c67ee4ff1753 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:19.023295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1ad8-7f02-4621-977c-c67ee4ff1753 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:19.023579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e1ad8-7f02-4621-977c-c67ee4ff1753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:19.054859 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-292e1ad8-7f02-4621-977c-c67ee4ff1753 None None] MFA Rules not processed for user `762db2415b2a479487c485c582d92c76`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:19.054859 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-292e1ad8-7f02-4621-977c-c67ee4ff1753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:19.072087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:19.128067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1277/2516] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:19.139605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc0889-82ac-4636-aaf0-786f8e648f4d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:19.141482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d6bc0889-82ac-4636-aaf0-786f8e648f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:19.204976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc0889-82ac-4636-aaf0-786f8e648f4d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:19.208834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb4682-0a61-4c84-bd27-b678f3c846c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:19.209474 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb4682-0a61-4c84-bd27-b678f3c846c0 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:19.209755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb4682-0a61-4c84-bd27-b678f3c846c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:19.210026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbb4682-0a61-4c84-bd27-b678f3c846c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:19.219791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb4682-0a61-4c84-bd27-b678f3c846c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:19.224199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbb4682-0a61-4c84-bd27-b678f3c846c0 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:19.231360 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1240/2517] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:19.454714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e1ad8-7f02-4621-977c-c67ee4ff1753 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:19.465537 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e1ad8-7f02-4621-977c-c67ee4ff1753 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:19.469133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34202d6-bf5c-422a-b3e5-b23fffc117c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:19.469776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34202d6-bf5c-422a-b3e5-b23fffc117c6 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:19.470174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34202d6-bf5c-422a-b3e5-b23fffc117c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:19.470373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34202d6-bf5c-422a-b3e5-b23fffc117c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:19.528769 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34202d6-bf5c-422a-b3e5-b23fffc117c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:19.530205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34202d6-bf5c-422a-b3e5-b23fffc117c6 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:19.539161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1278/2518] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:23.001379 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb4682-0a61-4c84-bd27-b678f3c846c0 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:23.008763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0cbb4682-0a61-4c84-bd27-b678f3c846c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:23.101981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:23.131860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbb4682-0a61-4c84-bd27-b678f3c846c0 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:23.139612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d4b8f-fb17-4476-bddc-285614bb4c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:23.140314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d4b8f-fb17-4476-bddc-285614bb4c7c service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:23.140685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d4b8f-fb17-4476-bddc-285614bb4c7c service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:23.141105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d4b8f-fb17-4476-bddc-285614bb4c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:23.143447 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34202d6-bf5c-422a-b3e5-b23fffc117c6 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:23.144522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-121d4b8f-fb17-4476-bddc-285614bb4c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:23.227514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34202d6-bf5c-422a-b3e5-b23fffc117c6 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:23.228617 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d4b8f-fb17-4476-bddc-285614bb4c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:23.230657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d4b8f-fb17-4476-bddc-285614bb4c7c service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:23.233101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:23.235019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:23.235436 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:23.235784 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] PATH_INFO: `/v3/users/b4adf34dbef5402ea68dec7be5bca7be` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:23.237155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4adf34dbef5402ea68dec7be5bca7be)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:23.239493 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:23.265722 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1241/2519] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:23.467262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:23.477419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4adf34dbef5402ea68dec7be5bca7be'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:23.477419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4adf34dbef5402ea68dec7be5bca7be'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:23.478189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4adf34dbef5402ea68dec7be5bca7be'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:23.558523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4adf34dbef5402ea68dec7be5bca7be'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:23.561448 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d4b8f-fb17-4476-bddc-285614bb4c7c service nova] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:23.568567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c7d6c6e9-aaac-405b-b521-f657bde074fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4adf34dbef5402ea68dec7be5bca7be'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:23.577835 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d4b8f-fb17-4476-bddc-285614bb4c7c service nova] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:23.586512 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e1c8f-ba45-495f-a149-e31ebaf7db2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:23.587338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e1c8f-ba45-495f-a149-e31ebaf7db2e service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:23.587628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e1c8f-ba45-495f-a149-e31ebaf7db2e service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:23.588167 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e1c8f-ba45-495f-a149-e31ebaf7db2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:23.590831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b51e1c8f-ba45-495f-a149-e31ebaf7db2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:23.594859 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1279/2520] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:23 2022] DELETE /identity/v3/users/b4adf34dbef5402ea68dec7be5bca7be => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:23.596702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e83816-44ff-4176-b900-0c33e1c17130 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:23.597126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e83816-44ff-4176-b900-0c33e1c17130 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:23.597496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e83816-44ff-4176-b900-0c33e1c17130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:23.613279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e1c8f-ba45-495f-a149-e31ebaf7db2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:23.615317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e1c8f-ba45-495f-a149-e31ebaf7db2e service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:23.630076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1242/2521] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:12:23.661132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a7e83816-44ff-4176-b900-0c33e1c17130 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:23.663151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a7e83816-44ff-4176-b900-0c33e1c17130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:23.759904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1280/2522] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:23.769972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e1c8f-ba45-495f-a149-e31ebaf7db2e service nova] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:23.771490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b51e1c8f-ba45-495f-a149-e31ebaf7db2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:23.841593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e1c8f-ba45-495f-a149-e31ebaf7db2e service nova] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:23.916271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37ad55-0d24-4541-99d7-c49ad078c747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:23.916271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37ad55-0d24-4541-99d7-c49ad078c747 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:23.916271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37ad55-0d24-4541-99d7-c49ad078c747 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:23.916271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37ad55-0d24-4541-99d7-c49ad078c747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:23.919127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37ad55-0d24-4541-99d7-c49ad078c747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:23.921032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37ad55-0d24-4541-99d7-c49ad078c747 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:23.926079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:23.931086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1243/2523] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:24.403881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e83816-44ff-4176-b900-0c33e1c17130 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:24.403881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a7e83816-44ff-4176-b900-0c33e1c17130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:24.417827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e83816-44ff-4176-b900-0c33e1c17130 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:24.426772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:24.430245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:24.430245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:24.430245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] PATH_INFO: `/v3/projects/3dab76c2889c45f0a25d7b96e2c0d047` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:24.431013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dab76c2889c45f0a25d7b96e2c0d047)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:24.432932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:24.595731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dab76c2889c45f0a25d7b96e2c0d047', 'request_id': 'req-c58d7099-5697-4343-8e43-428ce9268e4d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:24.601358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dab76c2889c45f0a25d7b96e2c0d047', 'request_id': 'req-c58d7099-5697-4343-8e43-428ce9268e4d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:24.608066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dab76c2889c45f0a25d7b96e2c0d047', 'request_id': 'req-c58d7099-5697-4343-8e43-428ce9268e4d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:24.704011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] The token cache is being invalidate because project 3dab76c2889c45f0a25d7b96e2c0d047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:24.704581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:24.705218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:24.706873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1281/2524] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:24 2022] DELETE /identity/v3/projects/3dab76c2889c45f0a25d7b96e2c0d047 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:24.710797 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37ad55-0d24-4541-99d7-c49ad078c747 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:24.721563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37ad55-0d24-4541-99d7-c49ad078c747 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:24.780315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:24.781244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:24.781548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:24.781822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] PATH_INFO: `/v3/users/762db2415b2a479487c485c582d92c76` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:24.783079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] RBAC: Authorizing `identity:delete_user(user_id=762db2415b2a479487c485c582d92c76)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:24.785142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:25.009772 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762db2415b2a479487c485c582d92c76'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:25.010424 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762db2415b2a479487c485c582d92c76'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:25.011261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762db2415b2a479487c485c582d92c76'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:25.019373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762db2415b2a479487c485c582d92c76'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:25.033933 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-8452bb19-d0dc-4b45-ae36-f730f0f6744b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762db2415b2a479487c485c582d92c76'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:25.126150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1244/2525] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:24 2022] DELETE /identity/v3/users/762db2415b2a479487c485c582d92c76 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:25.609216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:25.610992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:25.624503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d7099-5697-4343-8e43-428ce9268e4d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:25.642141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:25.684296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:25.685220 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:25.685546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:25.685831 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] PATH_INFO: `/v3/projects/3ff6a79ab3db49b4a323197ac5808b16` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:25.687093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff6a79ab3db49b4a323197ac5808b16)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:25.689059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:25.837050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff6a79ab3db49b4a323197ac5808b16', 'request_id': 'req-9d54c269-6a53-4a55-8316-4cd9f522a82c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:25.843527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff6a79ab3db49b4a323197ac5808b16', 'request_id': 'req-9d54c269-6a53-4a55-8316-4cd9f522a82c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:25.849746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff6a79ab3db49b4a323197ac5808b16', 'request_id': 'req-9d54c269-6a53-4a55-8316-4cd9f522a82c'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:25.960463 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] The token cache is being invalidate because project 3ff6a79ab3db49b4a323197ac5808b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:25.960871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:25.961575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-9d54c269-6a53-4a55-8316-4cd9f522a82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:25.968487 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1282/2526] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:25 2022] DELETE /identity/v3/projects/3ff6a79ab3db49b4a323197ac5808b16 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:25.970427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d45d79-d3cd-498b-8406-ae5ca32d64a3 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:25.970959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d45d79-d3cd-498b-8406-ae5ca32d64a3 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:25.971103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d45d79-d3cd-498b-8406-ae5ca32d64a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:25.999823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-54d45d79-d3cd-498b-8406-ae5ca32d64a3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:26.001046 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-54d45d79-d3cd-498b-8406-ae5ca32d64a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:26.061687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1245/2527] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:26.070544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f64a5d-4e35-418b-99e6-69d92bbb675f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:26.070836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f64a5d-4e35-418b-99e6-69d92bbb675f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:26.071152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f64a5d-4e35-418b-99e6-69d92bbb675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:26.092261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f1f64a5d-4e35-418b-99e6-69d92bbb675f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:26.093489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f1f64a5d-4e35-418b-99e6-69d92bbb675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:26.101579 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1283/2528] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:26.105816 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d45d79-d3cd-498b-8406-ae5ca32d64a3 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:26.115844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d45d79-d3cd-498b-8406-ae5ca32d64a3 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:26.120464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df4436-208f-40df-933b-1c07566f74a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:26.121129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df4436-208f-40df-933b-1c07566f74a9 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:26.121955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df4436-208f-40df-933b-1c07566f74a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:26.122275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df4436-208f-40df-933b-1c07566f74a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:26.123006 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df4436-208f-40df-933b-1c07566f74a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:12:26.123328 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df4436-208f-40df-933b-1c07566f74a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:26.124956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df4436-208f-40df-933b-1c07566f74a9 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:26.134525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:26.141821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1246/2529] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:12:26.142956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f64a5d-4e35-418b-99e6-69d92bbb675f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:26.152509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f64a5d-4e35-418b-99e6-69d92bbb675f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:26.163850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407b46-01d6-4688-a88a-4d6ddd4bd001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:26.164561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407b46-01d6-4688-a88a-4d6ddd4bd001 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:26.164865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407b46-01d6-4688-a88a-4d6ddd4bd001 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:26.165131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26407b46-01d6-4688-a88a-4d6ddd4bd001 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:26.166133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407b46-01d6-4688-a88a-4d6ddd4bd001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:26.167945 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26407b46-01d6-4688-a88a-4d6ddd4bd001 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:26.305380 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1284/2530] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:26 2022] POST /identity/v3/projects => generated 407 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:26.306525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df4436-208f-40df-933b-1c07566f74a9 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:26.318168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df4436-208f-40df-933b-1c07566f74a9 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:26.375108 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626974b3-5e99-4059-8dab-95b97e619bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:26.375859 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626974b3-5e99-4059-8dab-95b97e619bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:26.376101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626974b3-5e99-4059-8dab-95b97e619bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:26.376377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626974b3-5e99-4059-8dab-95b97e619bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:26.377116 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626974b3-5e99-4059-8dab-95b97e619bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:26.379072 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626974b3-5e99-4059-8dab-95b97e619bf8 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:26.518307 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1247/2531] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:26 2022] POST /identity/v3/users => generated 304 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:26.521210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407b46-01d6-4688-a88a-4d6ddd4bd001 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:26.535497 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26407b46-01d6-4688-a88a-4d6ddd4bd001 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:26.542066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41535916-fdc3-47a0-8b1f-c8fbae37aab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:26.543183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41535916-fdc3-47a0-8b1f-c8fbae37aab5 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:26.544154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41535916-fdc3-47a0-8b1f-c8fbae37aab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:26.544491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41535916-fdc3-47a0-8b1f-c8fbae37aab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:26.545225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41535916-fdc3-47a0-8b1f-c8fbae37aab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:26.546822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41535916-fdc3-47a0-8b1f-c8fbae37aab5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:26.557465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1285/2532] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:26.562256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626974b3-5e99-4059-8dab-95b97e619bf8 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:26.572306 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626974b3-5e99-4059-8dab-95b97e619bf8 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:26.577104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcf677-1156-4a61-9d67-79ff27aea34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:26.577754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcf677-1156-4a61-9d67-79ff27aea34e admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:26.578037 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcf677-1156-4a61-9d67-79ff27aea34e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:26.578314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcf677-1156-4a61-9d67-79ff27aea34e admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:26.579057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcf677-1156-4a61-9d67-79ff27aea34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:26.580649 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcf677-1156-4a61-9d67-79ff27aea34e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:26.591106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1248/2533] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:26.595402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41535916-fdc3-47a0-8b1f-c8fbae37aab5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:26.605634 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41535916-fdc3-47a0-8b1f-c8fbae37aab5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:26.616145 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914ebe8-8b79-4b7b-a43e-7b49aa123ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:26.616737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914ebe8-8b79-4b7b-a43e-7b49aa123ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:26.616989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914ebe8-8b79-4b7b-a43e-7b49aa123ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:26.617329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914ebe8-8b79-4b7b-a43e-7b49aa123ecf admin admin] PATH_INFO: `/v3/projects/d000cf66a7014704be13e64d317aec7a/users/6da30fcbc094404981a7be04e7ea3cdb/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:26.634434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914ebe8-8b79-4b7b-a43e-7b49aa123ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d000cf66a7014704be13e64d317aec7a, user_id=6da30fcbc094404981a7be04e7ea3cdb, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:26.637220 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914ebe8-8b79-4b7b-a43e-7b49aa123ecf admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:26.738559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1286/2534] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:26 2022] PUT /identity/v3/projects/d000cf66a7014704be13e64d317aec7a/users/6da30fcbc094404981a7be04e7ea3cdb/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:26.757233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceb44c-e6e8-42bf-b365-5b0d657745af None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:26.757526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceb44c-e6e8-42bf-b365-5b0d657745af None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:26.757839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ceb44c-e6e8-42bf-b365-5b0d657745af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:26.788235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-11ceb44c-e6e8-42bf-b365-5b0d657745af None None] MFA Rules not processed for user `6da30fcbc094404981a7be04e7ea3cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:26.789481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-11ceb44c-e6e8-42bf-b365-5b0d657745af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:26.855174 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1249/2535] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:26.859851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914ebe8-8b79-4b7b-a43e-7b49aa123ecf admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:26.909410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:26.923629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914ebe8-8b79-4b7b-a43e-7b49aa123ecf admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:26.929187 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f9c4-b154-4d13-8e3c-422b7aac86be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:26.929919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f9c4-b154-4d13-8e3c-422b7aac86be admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:26.930272 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f9c4-b154-4d13-8e3c-422b7aac86be admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:26.930657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f9c4-b154-4d13-8e3c-422b7aac86be admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:26.931494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11f9c4-b154-4d13-8e3c-422b7aac86be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:26.933464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d11f9c4-b154-4d13-8e3c-422b7aac86be admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:27.058924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1287/2536] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:26 2022] POST /identity/v3/projects => generated 409 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:27.063723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceb44c-e6e8-42bf-b365-5b0d657745af None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:27.075745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ceb44c-e6e8-42bf-b365-5b0d657745af None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:27.136752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a997f2-a5ce-4a9d-92b1-06f0720f749d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:27.138104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a997f2-a5ce-4a9d-92b1-06f0720f749d admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:27.138572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a997f2-a5ce-4a9d-92b1-06f0720f749d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:27.138872 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a997f2-a5ce-4a9d-92b1-06f0720f749d admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:27.139580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a997f2-a5ce-4a9d-92b1-06f0720f749d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:27.141652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a997f2-a5ce-4a9d-92b1-06f0720f749d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:27.226132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:27.233188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1250/2537] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:27 2022] POST /identity/v3/users => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:27.237501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f9c4-b154-4d13-8e3c-422b7aac86be admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:27.248527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d11f9c4-b154-4d13-8e3c-422b7aac86be admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:27.253340 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a5ca2-f19b-4c89-8591-67d3b7628a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:27.253848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a5ca2-f19b-4c89-8591-67d3b7628a6f admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:27.254122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a5ca2-f19b-4c89-8591-67d3b7628a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:27.254396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a5ca2-f19b-4c89-8591-67d3b7628a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:27.255160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a5ca2-f19b-4c89-8591-67d3b7628a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:27.256764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a5ca2-f19b-4c89-8591-67d3b7628a6f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:27.268483 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1288/2538] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:27.272628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a997f2-a5ce-4a9d-92b1-06f0720f749d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:27.283175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a997f2-a5ce-4a9d-92b1-06f0720f749d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:27.287765 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384e6f-0fd6-4012-9b62-7ac84142361c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:27.288635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384e6f-0fd6-4012-9b62-7ac84142361c admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:27.288925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384e6f-0fd6-4012-9b62-7ac84142361c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:27.289207 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384e6f-0fd6-4012-9b62-7ac84142361c admin admin] PATH_INFO: `/v3/projects/3bd2a818e07548218bae529f7098321b/users/bb481da40c114879a4a47db59cd52995/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:27.304982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384e6f-0fd6-4012-9b62-7ac84142361c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd2a818e07548218bae529f7098321b, user_id=bb481da40c114879a4a47db59cd52995, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:27.307798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384e6f-0fd6-4012-9b62-7ac84142361c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:27.474622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1251/2539] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:27 2022] PUT /identity/v3/projects/3bd2a818e07548218bae529f7098321b/users/bb481da40c114879a4a47db59cd52995/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:27.478659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a5ca2-f19b-4c89-8591-67d3b7628a6f admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:27.489391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a5ca2-f19b-4c89-8591-67d3b7628a6f admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:27.546998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dc73c-5208-4409-b766-cd216473dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:27.547673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc73c-5208-4409-b766-cd216473dbde admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:27.547955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc73c-5208-4409-b766-cd216473dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:27.548229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc73c-5208-4409-b766-cd216473dbde admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:27.548947 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dc73c-5208-4409-b766-cd216473dbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:27.550536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dc73c-5208-4409-b766-cd216473dbde admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:27.561662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1289/2540] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:27.565471 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384e6f-0fd6-4012-9b62-7ac84142361c admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:27.575859 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384e6f-0fd6-4012-9b62-7ac84142361c admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:27.580500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa47a90-e0da-4394-8e98-0b9c3b77d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:27.581344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa47a90-e0da-4394-8e98-0b9c3b77d28c admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:27.581620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa47a90-e0da-4394-8e98-0b9c3b77d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:27.581889 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa47a90-e0da-4394-8e98-0b9c3b77d28c admin admin] PATH_INFO: `/v3/projects/3bd2a818e07548218bae529f7098321b/users/bb481da40c114879a4a47db59cd52995/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:27.583861 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa47a90-e0da-4394-8e98-0b9c3b77d28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd2a818e07548218bae529f7098321b, user_id=bb481da40c114879a4a47db59cd52995, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:27.586484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa47a90-e0da-4394-8e98-0b9c3b77d28c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:27.598260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1252/2541] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:27 2022] PUT /identity/v3/projects/3bd2a818e07548218bae529f7098321b/users/bb481da40c114879a4a47db59cd52995/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:27.609686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef15ff-d333-4524-b930-081cde4a2535 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:27.609983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef15ff-d333-4524-b930-081cde4a2535 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:27.611594 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef15ff-d333-4524-b930-081cde4a2535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:27.638235 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-27ef15ff-d333-4524-b930-081cde4a2535 None None] MFA Rules not processed for user `bb481da40c114879a4a47db59cd52995`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:27.639546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-27ef15ff-d333-4524-b930-081cde4a2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:27.706643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1290/2542] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:27.717992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa47a90-e0da-4394-8e98-0b9c3b77d28c admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:27.719750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-aaa47a90-e0da-4394-8e98-0b9c3b77d28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:27.777156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa47a90-e0da-4394-8e98-0b9c3b77d28c admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:27.781561 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e154d-14f1-427e-a7ec-57239c86cd60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:27.782203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e154d-14f1-427e-a7ec-57239c86cd60 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:27.782484 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e154d-14f1-427e-a7ec-57239c86cd60 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:27.782755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e154d-14f1-427e-a7ec-57239c86cd60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:27.792632 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e154d-14f1-427e-a7ec-57239c86cd60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:27.795523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e154d-14f1-427e-a7ec-57239c86cd60 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:27.805890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1253/2543] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:28.233701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef15ff-d333-4524-b930-081cde4a2535 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:28.244625 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef15ff-d333-4524-b930-081cde4a2535 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:28.248887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65e350-4720-4ebc-b952-731856bf1b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:28.249533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65e350-4720-4ebc-b952-731856bf1b47 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:28.249813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65e350-4720-4ebc-b952-731856bf1b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:28.250085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65e350-4720-4ebc-b952-731856bf1b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:28.297904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:28.316644 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65e350-4720-4ebc-b952-731856bf1b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:28.318137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65e350-4720-4ebc-b952-731856bf1b47 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:28.327570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1291/2544] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:28 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:29.279397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e154d-14f1-427e-a7ec-57239c86cd60 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:29.280930 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-268e154d-14f1-427e-a7ec-57239c86cd60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:29.368656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e154d-14f1-427e-a7ec-57239c86cd60 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:29.373576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0d625-de85-43d3-9d18-baed6df3ae9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:29.374241 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0d625-de85-43d3-9d18-baed6df3ae9e service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:29.374544 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0d625-de85-43d3-9d18-baed6df3ae9e service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:29.375001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0d625-de85-43d3-9d18-baed6df3ae9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:29.376895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ead0d625-de85-43d3-9d18-baed6df3ae9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:29.440652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:29.457049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0d625-de85-43d3-9d18-baed6df3ae9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:29.458503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0d625-de85-43d3-9d18-baed6df3ae9e service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:29.479468 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1254/2545] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:33.640037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65e350-4720-4ebc-b952-731856bf1b47 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:33.641527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3a65e350-4720-4ebc-b952-731856bf1b47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:33.661658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65e350-4720-4ebc-b952-731856bf1b47 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:33.663079 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:33.664032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:33.664236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:33.664514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] PATH_INFO: `/v3/users/7caf8c01365b4918abf24203b7a14dfa` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:33.665694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7caf8c01365b4918abf24203b7a14dfa)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:33.669728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:33.906410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7caf8c01365b4918abf24203b7a14dfa'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:33.907007 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7caf8c01365b4918abf24203b7a14dfa'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:33.907600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7caf8c01365b4918abf24203b7a14dfa'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:34.002746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7caf8c01365b4918abf24203b7a14dfa'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:34.010186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-54103c48-b0ed-4357-81b1-792ea6ea3685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7caf8c01365b4918abf24203b7a14dfa'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:34.034164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1292/2546] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:33 2022] DELETE /identity/v3/users/7caf8c01365b4918abf24203b7a14dfa => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:34.325874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0d625-de85-43d3-9d18-baed6df3ae9e service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:34.336646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0d625-de85-43d3-9d18-baed6df3ae9e service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:34.398979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:34.399860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:34.400144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:34.400426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] PATH_INFO: `/v3/projects/191298ea8b7d48f981aa4abf8b154b55` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:34.401602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=191298ea8b7d48f981aa4abf8b154b55)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:34.404552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:34.525663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191298ea8b7d48f981aa4abf8b154b55', 'request_id': 'req-d267b385-df07-4cbe-8c92-c9a0b8352b27'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:34.531628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191298ea8b7d48f981aa4abf8b154b55', 'request_id': 'req-d267b385-df07-4cbe-8c92-c9a0b8352b27'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:34.537970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191298ea8b7d48f981aa4abf8b154b55', 'request_id': 'req-d267b385-df07-4cbe-8c92-c9a0b8352b27'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:34.645417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] The token cache is being invalidate because project 191298ea8b7d48f981aa4abf8b154b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:34.651318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:34.651318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-d267b385-df07-4cbe-8c92-c9a0b8352b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:34.651318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1255/2547] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:34 2022] DELETE /identity/v3/projects/191298ea8b7d48f981aa4abf8b154b55 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:34.653642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa34d11-b900-42b8-b386-52d5f63a1c3f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:34.654093 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa34d11-b900-42b8-b386-52d5f63a1c3f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:34.654357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa34d11-b900-42b8-b386-52d5f63a1c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:34.684338 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-1aa34d11-b900-42b8-b386-52d5f63a1c3f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:34.685859 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1aa34d11-b900-42b8-b386-52d5f63a1c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:34.745865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1293/2548] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:34.754663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f5d1b-4d4c-4f96-82ce-3ca56ff1e458 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:34.754956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f5d1b-4d4c-4f96-82ce-3ca56ff1e458 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:34.755298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f5d1b-4d4c-4f96-82ce-3ca56ff1e458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:34.773940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-267f5d1b-4d4c-4f96-82ce-3ca56ff1e458 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:34.776847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-267f5d1b-4d4c-4f96-82ce-3ca56ff1e458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:34.783557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1256/2549] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:34.787830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa34d11-b900-42b8-b386-52d5f63a1c3f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:34.798468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa34d11-b900-42b8-b386-52d5f63a1c3f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:34.803567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e7355-4f7c-4cf8-80e4-6c1a5401cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:34.804468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e7355-4f7c-4cf8-80e4-6c1a5401cca8 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:34.804759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e7355-4f7c-4cf8-80e4-6c1a5401cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:34.805038 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e7355-4f7c-4cf8-80e4-6c1a5401cca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:34.805785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e7355-4f7c-4cf8-80e4-6c1a5401cca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:12:34.806095 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e7355-4f7c-4cf8-80e4-6c1a5401cca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:34.807830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e7355-4f7c-4cf8-80e4-6c1a5401cca8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:34.821717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1294/2550] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:12:34.826497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f5d1b-4d4c-4f96-82ce-3ca56ff1e458 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:34.836628 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f5d1b-4d4c-4f96-82ce-3ca56ff1e458 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:34.842011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6414d0-3fac-4108-9faa-dc38d7431d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:34.842702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6414d0-3fac-4108-9faa-dc38d7431d24 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:34.843011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6414d0-3fac-4108-9faa-dc38d7431d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:34.843296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6414d0-3fac-4108-9faa-dc38d7431d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:34.844001 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6414d0-3fac-4108-9faa-dc38d7431d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:34.846000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6414d0-3fac-4108-9faa-dc38d7431d24 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:34.946739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1257/2551] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:34 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:34.951138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e7355-4f7c-4cf8-80e4-6c1a5401cca8 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:34.961149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e7355-4f7c-4cf8-80e4-6c1a5401cca8 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:34.990612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:35.025587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8664ee-f5aa-4c55-a5ec-ac35a701957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:35.026288 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8664ee-f5aa-4c55-a5ec-ac35a701957d admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:35.026573 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8664ee-f5aa-4c55-a5ec-ac35a701957d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:35.026905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8664ee-f5aa-4c55-a5ec-ac35a701957d admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:35.027723 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8664ee-f5aa-4c55-a5ec-ac35a701957d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:35.029728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8664ee-f5aa-4c55-a5ec-ac35a701957d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:35.125825 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1295/2552] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:34 2022] POST /identity/v3/users => generated 302 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:35.129825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6414d0-3fac-4108-9faa-dc38d7431d24 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:35.140109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6414d0-3fac-4108-9faa-dc38d7431d24 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:35.144803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e41fea-dd67-4ae1-993c-0b1cf9aa3a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:35.145450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e41fea-dd67-4ae1-993c-0b1cf9aa3a42 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:35.145810 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e41fea-dd67-4ae1-993c-0b1cf9aa3a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:35.146085 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e41fea-dd67-4ae1-993c-0b1cf9aa3a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:35.146805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e41fea-dd67-4ae1-993c-0b1cf9aa3a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:35.148435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e41fea-dd67-4ae1-993c-0b1cf9aa3a42 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:35.159478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1258/2553] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:35.163448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8664ee-f5aa-4c55-a5ec-ac35a701957d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:35.173989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8664ee-f5aa-4c55-a5ec-ac35a701957d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:35.178800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b870c12-b5c5-4f3b-9cf9-79adcbaa9f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:35.179490 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870c12-b5c5-4f3b-9cf9-79adcbaa9f02 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:35.179778 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870c12-b5c5-4f3b-9cf9-79adcbaa9f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:35.180059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b870c12-b5c5-4f3b-9cf9-79adcbaa9f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:35.180773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b870c12-b5c5-4f3b-9cf9-79adcbaa9f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:35.182371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b870c12-b5c5-4f3b-9cf9-79adcbaa9f02 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:35.192529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1296/2554] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:35.196453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e41fea-dd67-4ae1-993c-0b1cf9aa3a42 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:35.206518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e41fea-dd67-4ae1-993c-0b1cf9aa3a42 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:35.211221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e425d-b4a0-44bd-b54c-6d94386e85a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:35.212088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e425d-b4a0-44bd-b54c-6d94386e85a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:35.212364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e425d-b4a0-44bd-b54c-6d94386e85a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:35.212634 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e425d-b4a0-44bd-b54c-6d94386e85a9 admin admin] PATH_INFO: `/v3/projects/ea43a505b03f4994bd2866478639fe37/users/5a3c93f2bde343dfb152fa787d82aa48/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:35.228684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e425d-b4a0-44bd-b54c-6d94386e85a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea43a505b03f4994bd2866478639fe37, user_id=5a3c93f2bde343dfb152fa787d82aa48, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:35.232032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e425d-b4a0-44bd-b54c-6d94386e85a9 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:35.319875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1259/2555] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:35 2022] PUT /identity/v3/projects/ea43a505b03f4994bd2866478639fe37/users/5a3c93f2bde343dfb152fa787d82aa48/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:35.330801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bebb0-22ac-4db6-8f11-0b34191935a6 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:35.331139 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bebb0-22ac-4db6-8f11-0b34191935a6 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:35.331426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bebb0-22ac-4db6-8f11-0b34191935a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:35.349865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ed4bebb0-22ac-4db6-8f11-0b34191935a6 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:35.351105 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ed4bebb0-22ac-4db6-8f11-0b34191935a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:35.410725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1297/2556] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:35.420997 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e425d-b4a0-44bd-b54c-6d94386e85a9 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:35.422718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-3a2e425d-b4a0-44bd-b54c-6d94386e85a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:35.428240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:35.479570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e425d-b4a0-44bd-b54c-6d94386e85a9 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:35.484534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1083821-28b4-4275-8a85-b9191d8f4aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:35.485176 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1083821-28b4-4275-8a85-b9191d8f4aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:35.485458 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1083821-28b4-4275-8a85-b9191d8f4aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:35.485734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1083821-28b4-4275-8a85-b9191d8f4aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:35.494629 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1083821-28b4-4275-8a85-b9191d8f4aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:35.496088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1083821-28b4-4275-8a85-b9191d8f4aa4 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:35.505577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1260/2557] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:37.078550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e408-9f6b-4880-9138-ea72e22e2384 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:37.079219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e408-9f6b-4880-9138-ea72e22e2384 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:37.079219 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75e408-9f6b-4880-9138-ea72e22e2384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:37.119678 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-0b75e408-9f6b-4880-9138-ea72e22e2384 None None] MFA Rules not processed for user `5a3c93f2bde343dfb152fa787d82aa48`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:37.121114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0b75e408-9f6b-4880-9138-ea72e22e2384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:37.191375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1298/2558] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:37.195939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1083821-28b4-4275-8a85-b9191d8f4aa4 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:37.205769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1083821-28b4-4275-8a85-b9191d8f4aa4 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:37.210494 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51da36a-c252-466c-b153-50b2754bef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:37.211183 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51da36a-c252-466c-b153-50b2754bef8d admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:37.211470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51da36a-c252-466c-b153-50b2754bef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:37.211746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51da36a-c252-466c-b153-50b2754bef8d admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:37.212426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51da36a-c252-466c-b153-50b2754bef8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:37.214953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51da36a-c252-466c-b153-50b2754bef8d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:37.333210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1261/2559] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:37 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:37.337140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75e408-9f6b-4880-9138-ea72e22e2384 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:37.348563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75e408-9f6b-4880-9138-ea72e22e2384 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:37.388247 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:37.407851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd6602-1619-4cc6-8c34-6ac0643318ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:37.408457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6602-1619-4cc6-8c34-6ac0643318ff admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:37.408749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6602-1619-4cc6-8c34-6ac0643318ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:37.409029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6602-1619-4cc6-8c34-6ac0643318ff admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:37.409732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd6602-1619-4cc6-8c34-6ac0643318ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:37.411886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd6602-1619-4cc6-8c34-6ac0643318ff admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:37.511817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1299/2560] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:37 2022] POST /identity/v3/users => generated 308 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:37.513310 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51da36a-c252-466c-b153-50b2754bef8d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:37.523829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51da36a-c252-466c-b153-50b2754bef8d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:37.529428 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff588c7b-ca9b-4564-8a9a-65009e7996ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:37.530118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff588c7b-ca9b-4564-8a9a-65009e7996ec admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:37.530452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff588c7b-ca9b-4564-8a9a-65009e7996ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:37.530713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff588c7b-ca9b-4564-8a9a-65009e7996ec admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:37.531485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff588c7b-ca9b-4564-8a9a-65009e7996ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:37.533085 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff588c7b-ca9b-4564-8a9a-65009e7996ec admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:37.544703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1262/2561] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:37.548926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd6602-1619-4cc6-8c34-6ac0643318ff admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:37.559248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd6602-1619-4cc6-8c34-6ac0643318ff admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:37.564158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624a3d0-c034-4e86-9093-92e43ee310a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:37.565029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624a3d0-c034-4e86-9093-92e43ee310a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:37.565318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624a3d0-c034-4e86-9093-92e43ee310a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:37.565598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624a3d0-c034-4e86-9093-92e43ee310a0 admin admin] PATH_INFO: `/v3/projects/6213aada6e0648f6a47a06661455ce3e/users/a4cfff2fe32a46eca3622755665da902/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:37.580414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624a3d0-c034-4e86-9093-92e43ee310a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6213aada6e0648f6a47a06661455ce3e, user_id=a4cfff2fe32a46eca3622755665da902, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:37.583165 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624a3d0-c034-4e86-9093-92e43ee310a0 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:37.680261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1300/2562] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:37 2022] PUT /identity/v3/projects/6213aada6e0648f6a47a06661455ce3e/users/a4cfff2fe32a46eca3622755665da902/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:37.684495 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff588c7b-ca9b-4564-8a9a-65009e7996ec admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:37.694480 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff588c7b-ca9b-4564-8a9a-65009e7996ec admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:37.754913 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bd630-af0f-4b60-99c8-2322127df306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:37.755650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd630-af0f-4b60-99c8-2322127df306 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:37.755934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd630-af0f-4b60-99c8-2322127df306 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:37.756208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd630-af0f-4b60-99c8-2322127df306 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:37.756932 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bd630-af0f-4b60-99c8-2322127df306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:37.758520 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bd630-af0f-4b60-99c8-2322127df306 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:37.769691 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1263/2563] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:37.773898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624a3d0-c034-4e86-9093-92e43ee310a0 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:37.785162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624a3d0-c034-4e86-9093-92e43ee310a0 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:37.789913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e17f-704e-4de9-ae74-04cdca3dcfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:37.790912 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e17f-704e-4de9-ae74-04cdca3dcfcc admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:37.791292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e17f-704e-4de9-ae74-04cdca3dcfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:37.791634 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147e17f-704e-4de9-ae74-04cdca3dcfcc admin admin] PATH_INFO: `/v3/projects/6213aada6e0648f6a47a06661455ce3e/users/a4cfff2fe32a46eca3622755665da902/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:37.793893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147e17f-704e-4de9-ae74-04cdca3dcfcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6213aada6e0648f6a47a06661455ce3e, user_id=a4cfff2fe32a46eca3622755665da902, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:37.800721 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147e17f-704e-4de9-ae74-04cdca3dcfcc admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:37.812829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1301/2564] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:37 2022] PUT /identity/v3/projects/6213aada6e0648f6a47a06661455ce3e/users/a4cfff2fe32a46eca3622755665da902/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:39.211100 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23ec15-6fa9-45b0-96c9-5034bfb6e52d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:39.211645 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23ec15-6fa9-45b0-96c9-5034bfb6e52d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:39.211773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23ec15-6fa9-45b0-96c9-5034bfb6e52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:39.239934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4a23ec15-6fa9-45b0-96c9-5034bfb6e52d None None] MFA Rules not processed for user `a4cfff2fe32a46eca3622755665da902`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:39.241152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4a23ec15-6fa9-45b0-96c9-5034bfb6e52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:39.303496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:39.314910 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1264/2565] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:39 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:39.844308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e17f-704e-4de9-ae74-04cdca3dcfcc admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:39.846108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4147e17f-704e-4de9-ae74-04cdca3dcfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:39.905866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147e17f-704e-4de9-ae74-04cdca3dcfcc admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:39.909582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a770834-eba9-4b3c-a3d5-815a52eeec4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:39.910230 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a770834-eba9-4b3c-a3d5-815a52eeec4e service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:39.910516 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a770834-eba9-4b3c-a3d5-815a52eeec4e service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:39.910792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a770834-eba9-4b3c-a3d5-815a52eeec4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:39.912834 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4a770834-eba9-4b3c-a3d5-815a52eeec4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:39.978112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a770834-eba9-4b3c-a3d5-815a52eeec4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:39.979814 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a770834-eba9-4b3c-a3d5-815a52eeec4e service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:39.990867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1302/2566] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:40.047713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456077d-9cfa-44df-9896-f69aa474f181 None None] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:40.050940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456077d-9cfa-44df-9896-f69aa474f181 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:40.050940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456077d-9cfa-44df-9896-f69aa474f181 None None] PATH_INFO: `/` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:40.050940 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1265/2567] 10.222.0.42 () {54 vars in 921 bytes} [Fri May 27 14:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 14:12:40.064566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cee1-50ee-46fb-bdef-13cafd693383 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:40.064854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cee1-50ee-46fb-bdef-13cafd693383 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:40.065127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cee1-50ee-46fb-bdef-13cafd693383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:40.084318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ae02cee1-50ee-46fb-bdef-13cafd693383 None None] MFA Rules not processed for user `b6375aed65de46e19a9d3da583b42bbd`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:40.085557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ae02cee1-50ee-46fb-bdef-13cafd693383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:40.128035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:40.154468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1303/2568] 10.222.0.42 () {58 vars in 1018 bytes} [Fri May 27 14:12:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:40.165530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456077d-9cfa-44df-9896-f69aa474f181 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:40.167430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8456077d-9cfa-44df-9896-f69aa474f181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:40.189980 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456077d-9cfa-44df-9896-f69aa474f181 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:40.197875 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1792d-9c18-4a95-8535-0316f3642c9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:40.198685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1792d-9c18-4a95-8535-0316f3642c9f service placement] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:40.199067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1792d-9c18-4a95-8535-0316f3642c9f service placement] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:40.200013 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1792d-9c18-4a95-8535-0316f3642c9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:40.215866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1792d-9c18-4a95-8535-0316f3642c9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:40.217730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1792d-9c18-4a95-8535-0316f3642c9f service placement] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:40.228148 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1266/2569] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:40.961369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02cee1-50ee-46fb-bdef-13cafd693383 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:40.962893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ae02cee1-50ee-46fb-bdef-13cafd693383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:40.976801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02cee1-50ee-46fb-bdef-13cafd693383 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:40.982183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:40.983156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:40.983438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:40.983712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] PATH_INFO: `/v3/users/6da30fcbc094404981a7be04e7ea3cdb` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:40.985225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da30fcbc094404981a7be04e7ea3cdb)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:40.987218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:41.249111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da30fcbc094404981a7be04e7ea3cdb'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:41.249793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da30fcbc094404981a7be04e7ea3cdb'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:41.250369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da30fcbc094404981a7be04e7ea3cdb'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:41.271924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1792d-9c18-4a95-8535-0316f3642c9f service placement] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:41.283076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1792d-9c18-4a95-8535-0316f3642c9f service placement] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:41.287918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:41.288783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:41.289064 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:41.289335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] PATH_INFO: `/v3/users/5a3c93f2bde343dfb152fa787d82aa48` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:41.290529 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3c93f2bde343dfb152fa787d82aa48)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:41.292477 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:41.350830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da30fcbc094404981a7be04e7ea3cdb'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:41.361362 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7e21af6e-796b-4175-9273-319eae6dd099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da30fcbc094404981a7be04e7ea3cdb'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:41.386364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1304/2570] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:40 2022] DELETE /identity/v3/users/6da30fcbc094404981a7be04e7ea3cdb => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:41.390732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e235f8-2022-4165-b399-93a01b23ff00 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:41.391066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e235f8-2022-4165-b399-93a01b23ff00 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:41.391374 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e235f8-2022-4165-b399-93a01b23ff00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:41.411867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-89e235f8-2022-4165-b399-93a01b23ff00 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:41.413190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-89e235f8-2022-4165-b399-93a01b23ff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:41.495726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1305/2571] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:12:41.505891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e235f8-2022-4165-b399-93a01b23ff00 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:41.508113 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-89e235f8-2022-4165-b399-93a01b23ff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:41.572644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3c93f2bde343dfb152fa787d82aa48'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:41.573431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3c93f2bde343dfb152fa787d82aa48'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:41.574097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3c93f2bde343dfb152fa787d82aa48'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:41.582728 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e235f8-2022-4165-b399-93a01b23ff00 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:41.583017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3c93f2bde343dfb152fa787d82aa48'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:41.589821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef0abc-6eaa-4394-9aaa-f9b082bc84d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:41.591329 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef0abc-6eaa-4394-9aaa-f9b082bc84d7 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:41.591616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef0abc-6eaa-4394-9aaa-f9b082bc84d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:41.592087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef0abc-6eaa-4394-9aaa-f9b082bc84d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:41.593894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-beef0abc-6eaa-4394-9aaa-f9b082bc84d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:41.599701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3c93f2bde343dfb152fa787d82aa48'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:41.603780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:41.608248 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef0abc-6eaa-4394-9aaa-f9b082bc84d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:41.609732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef0abc-6eaa-4394-9aaa-f9b082bc84d7 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:41.619987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1306/2572] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:12:41.764396 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1267/2573] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:41 2022] DELETE /identity/v3/users/5a3c93f2bde343dfb152fa787d82aa48 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:42.130171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef0abc-6eaa-4394-9aaa-f9b082bc84d7 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:42.131806 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-beef0abc-6eaa-4394-9aaa-f9b082bc84d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:42.163992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:42.165767 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:42.172922 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef0abc-6eaa-4394-9aaa-f9b082bc84d7 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:42.281909 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:42.282888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:42.284405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:42.284688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] PATH_INFO: `/v3/projects/ea43a505b03f4994bd2866478639fe37` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:42.286084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea43a505b03f4994bd2866478639fe37)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:42.289701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:42.295556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7608f-f249-4d7d-961f-9069fd1643d0 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:42.306890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:42.307798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:42.308078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:42.308350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] PATH_INFO: `/v3/projects/d000cf66a7014704be13e64d317aec7a` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:42.313476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d000cf66a7014704be13e64d317aec7a)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:42.316958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:42.428486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea43a505b03f4994bd2866478639fe37', 'request_id': 'req-73c6f31b-06f2-4489-91a3-e8ae33791464'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.434220 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea43a505b03f4994bd2866478639fe37', 'request_id': 'req-73c6f31b-06f2-4489-91a3-e8ae33791464'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.442687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea43a505b03f4994bd2866478639fe37', 'request_id': 'req-73c6f31b-06f2-4489-91a3-e8ae33791464'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.461265 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd000cf66a7014704be13e64d317aec7a', 'request_id': 'req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.466425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:42.468912 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd000cf66a7014704be13e64d317aec7a', 'request_id': 'req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.475860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd000cf66a7014704be13e64d317aec7a', 'request_id': 'req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.559506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] The token cache is being invalidate because project ea43a505b03f4994bd2866478639fe37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:42.559506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.559752 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.561532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1307/2574] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:42 2022] DELETE /identity/v3/projects/ea43a505b03f4994bd2866478639fe37 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:42.565448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:42.566915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:42.614395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] The token cache is being invalidate because project d000cf66a7014704be13e64d317aec7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:42.614688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.616718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.621505 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1268/2575] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:42 2022] DELETE /identity/v3/projects/d000cf66a7014704be13e64d317aec7a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:42.622708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:42.625206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:42.667628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6f31b-06f2-4489-91a3-e8ae33791464 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:42.713732 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:42.720453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7eb5b-97e5-4cda-9219-5bf5e82ab978 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:42.725740 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:42.726627 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:42.727320 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:42.727463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] PATH_INFO: `/v3/users/bb481da40c114879a4a47db59cd52995` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:42.731052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb481da40c114879a4a47db59cd52995)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:42.731052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:42.745725 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:42.747729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:42.748124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:42.748546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] PATH_INFO: `/v3/users/a4cfff2fe32a46eca3622755665da902` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:42.749870 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cfff2fe32a46eca3622755665da902)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:42.751953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:42.907422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb481da40c114879a4a47db59cd52995'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.908102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb481da40c114879a4a47db59cd52995'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.908774 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb481da40c114879a4a47db59cd52995'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.916839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb481da40c114879a4a47db59cd52995'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.920245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cfff2fe32a46eca3622755665da902'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.920245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cfff2fe32a46eca3622755665da902'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.920245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cfff2fe32a46eca3622755665da902'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:42.931240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb481da40c114879a4a47db59cd52995'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:43.000092 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cfff2fe32a46eca3622755665da902'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:43.007974 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cfff2fe32a46eca3622755665da902'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:43.029879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1308/2576] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:42 2022] DELETE /identity/v3/users/a4cfff2fe32a46eca3622755665da902 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:43.100903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1269/2577] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:42 2022] DELETE /identity/v3/users/bb481da40c114879a4a47db59cd52995 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:43.290298 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:43.291893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:43.385809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46dbff-91bb-4a25-802a-dcd4ad9e911b admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:43.498717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:43.500221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:43.500640 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:43.501019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] PATH_INFO: `/v3/projects/6213aada6e0648f6a47a06661455ce3e` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:43.502417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6213aada6e0648f6a47a06661455ce3e)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:43.504458 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:43.545969 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:43.756292 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:43.757901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:43.775800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39619450-cd4c-488d-9c4b-d241322f6579 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:43.823365 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6213aada6e0648f6a47a06661455ce3e', 'request_id': 'req-ac1aa4d2-5522-4aa5-a956-a14c06beff58'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:43.832017 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6213aada6e0648f6a47a06661455ce3e', 'request_id': 'req-ac1aa4d2-5522-4aa5-a956-a14c06beff58'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:43.841428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6213aada6e0648f6a47a06661455ce3e', 'request_id': 'req-ac1aa4d2-5522-4aa5-a956-a14c06beff58'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:43.867173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:43.868603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:43.868603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:43.868840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] PATH_INFO: `/v3/projects/3bd2a818e07548218bae529f7098321b` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:43.870253 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd2a818e07548218bae529f7098321b)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:43.873168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:43.875857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:43.963229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] The token cache is being invalidate because project 6213aada6e0648f6a47a06661455ce3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:43.963927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:43.965073 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ac1aa4d2-5522-4aa5-a956-a14c06beff58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:43.967175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1309/2578] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:43 2022] DELETE /identity/v3/projects/6213aada6e0648f6a47a06661455ce3e => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:43.972303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61a7d6-09be-4f55-9e35-5c41dad58c62 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:43.972597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61a7d6-09be-4f55-9e35-5c41dad58c62 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:43.972877 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61a7d6-09be-4f55-9e35-5c41dad58c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:43.991987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-eb61a7d6-09be-4f55-9e35-5c41dad58c62 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:43.993206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-eb61a7d6-09be-4f55-9e35-5c41dad58c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:44.002197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1310/2579] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:44.016895 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfbef4-126c-4160-8346-a8d0226d103f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.017181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfbef4-126c-4160-8346-a8d0226d103f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.017455 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfbef4-126c-4160-8346-a8d0226d103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.035608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-84bfbef4-126c-4160-8346-a8d0226d103f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:44.036761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-84bfbef4-126c-4160-8346-a8d0226d103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:44.045386 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1311/2580] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:12:44.049349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfbef4-126c-4160-8346-a8d0226d103f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.059734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfbef4-126c-4160-8346-a8d0226d103f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.069110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd2a818e07548218bae529f7098321b', 'request_id': 'req-ddafa7a3-507b-452f-a065-6d194a927d5f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:44.074569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd2a818e07548218bae529f7098321b', 'request_id': 'req-ddafa7a3-507b-452f-a065-6d194a927d5f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:44.081017 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd2a818e07548218bae529f7098321b', 'request_id': 'req-ddafa7a3-507b-452f-a065-6d194a927d5f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:44.124387 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f99d96-69e1-4246-b467-96e1a41714d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.125148 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f99d96-69e1-4246-b467-96e1a41714d1 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.125522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f99d96-69e1-4246-b467-96e1a41714d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.125792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f99d96-69e1-4246-b467-96e1a41714d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.126618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f99d96-69e1-4246-b467-96e1a41714d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:12:44.126939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f99d96-69e1-4246-b467-96e1a41714d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.128898 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f99d96-69e1-4246-b467-96e1a41714d1 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:44.142206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1312/2581] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:12:44.146401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f99d96-69e1-4246-b467-96e1a41714d1 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.156714 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f99d96-69e1-4246-b467-96e1a41714d1 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.162632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35a66a-476c-41da-bffa-75c05cd9c283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.163323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35a66a-476c-41da-bffa-75c05cd9c283 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.163687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35a66a-476c-41da-bffa-75c05cd9c283 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.163999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35a66a-476c-41da-bffa-75c05cd9c283 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.164741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35a66a-476c-41da-bffa-75c05cd9c283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.166668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35a66a-476c-41da-bffa-75c05cd9c283 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:44.229005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] The token cache is being invalidate because project 3bd2a818e07548218bae529f7098321b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:44.229345 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:44.230028 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ddafa7a3-507b-452f-a065-6d194a927d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:44.232684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1270/2582] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:43 2022] DELETE /identity/v3/projects/3bd2a818e07548218bae529f7098321b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:44.240715 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820a791-25fd-4b89-a672-c44ef53c615f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.241008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820a791-25fd-4b89-a672-c44ef53c615f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.241490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820a791-25fd-4b89-a672-c44ef53c615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.263208 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-2820a791-25fd-4b89-a672-c44ef53c615f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:44.264616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2820a791-25fd-4b89-a672-c44ef53c615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:44.288714 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1271/2583] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:44.290219 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211fc78-32b4-4b09-a711-683a482b9aec None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.290536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211fc78-32b4-4b09-a711-683a482b9aec None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.290934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211fc78-32b4-4b09-a711-683a482b9aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.311564 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a211fc78-32b4-4b09-a711-683a482b9aec None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:44.312822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a211fc78-32b4-4b09-a711-683a482b9aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:44.319872 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1313/2584] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:44 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:44.325661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35a66a-476c-41da-bffa-75c05cd9c283 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.326119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1272/2585] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:44.327976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1a35a66a-476c-41da-bffa-75c05cd9c283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:44.329838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211fc78-32b4-4b09-a711-683a482b9aec None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.341705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211fc78-32b4-4b09-a711-683a482b9aec None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.400535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35a66a-476c-41da-bffa-75c05cd9c283 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.405841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab860f7-c00e-48d6-8460-5d56f85d9066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.406511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab860f7-c00e-48d6-8460-5d56f85d9066 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.406800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab860f7-c00e-48d6-8460-5d56f85d9066 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.407131 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab860f7-c00e-48d6-8460-5d56f85d9066 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.407804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab860f7-c00e-48d6-8460-5d56f85d9066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.409735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab860f7-c00e-48d6-8460-5d56f85d9066 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:44.412594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3de130-1272-4984-bbf2-5888cd2a84d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.413252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3de130-1272-4984-bbf2-5888cd2a84d5 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.413534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3de130-1272-4984-bbf2-5888cd2a84d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.413809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3de130-1272-4984-bbf2-5888cd2a84d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.414530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3de130-1272-4984-bbf2-5888cd2a84d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:12:44.414883 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3de130-1272-4984-bbf2-5888cd2a84d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.416513 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3de130-1272-4984-bbf2-5888cd2a84d5 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:44.430430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1273/2586] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:12:44.434724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3de130-1272-4984-bbf2-5888cd2a84d5 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.444230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3de130-1272-4984-bbf2-5888cd2a84d5 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.448956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fe4f6-6544-4b82-8aa6-99870ad4fc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.450068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fe4f6-6544-4b82-8aa6-99870ad4fc7a admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.450272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fe4f6-6544-4b82-8aa6-99870ad4fc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.450561 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641fe4f6-6544-4b82-8aa6-99870ad4fc7a admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.451284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fe4f6-6544-4b82-8aa6-99870ad4fc7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.465901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641fe4f6-6544-4b82-8aa6-99870ad4fc7a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:44.491583 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1314/2587] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:44 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:44.498572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab860f7-c00e-48d6-8460-5d56f85d9066 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.498572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cab860f7-c00e-48d6-8460-5d56f85d9066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:44.506524 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab860f7-c00e-48d6-8460-5d56f85d9066 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.511261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.512851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.513130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.513401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] PATH_INFO: `/v3/users/2e7ba82a80834a4aa098e9604165cfad` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.514593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7ba82a80834a4aa098e9604165cfad)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.516559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:44.580153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1274/2588] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:44 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:44.580153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fe4f6-6544-4b82-8aa6-99870ad4fc7a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.637735 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641fe4f6-6544-4b82-8aa6-99870ad4fc7a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.642731 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf8081-023c-46c6-9c5d-40b6d369e730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.643488 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf8081-023c-46c6-9c5d-40b6d369e730 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.643768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf8081-023c-46c6-9c5d-40b6d369e730 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.644107 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf8081-023c-46c6-9c5d-40b6d369e730 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.644846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf8081-023c-46c6-9c5d-40b6d369e730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.646502 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf8081-023c-46c6-9c5d-40b6d369e730 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:44.660734 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1275/2589] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:44.661448 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf8081-023c-46c6-9c5d-40b6d369e730 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.675190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf8081-023c-46c6-9c5d-40b6d369e730 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.680237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a7aed-d768-448a-873c-862f1a0b11f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.680896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a7aed-d768-448a-873c-862f1a0b11f9 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.681178 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a7aed-d768-448a-873c-862f1a0b11f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.681453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a7aed-d768-448a-873c-862f1a0b11f9 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.682130 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a7aed-d768-448a-873c-862f1a0b11f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.684188 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a7aed-d768-448a-873c-862f1a0b11f9 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:44.807119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7ba82a80834a4aa098e9604165cfad'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:44.807811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7ba82a80834a4aa098e9604165cfad'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:44.808475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7ba82a80834a4aa098e9604165cfad'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:44.834729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1276/2590] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:44 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:44.835635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a7aed-d768-448a-873c-862f1a0b11f9 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.837282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-601a7aed-d768-448a-873c-862f1a0b11f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:44.850140 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a7aed-d768-448a-873c-862f1a0b11f9 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.854757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8a5c0-9dfa-4430-90a2-c1632e9a0d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.855455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8a5c0-9dfa-4430-90a2-c1632e9a0d5b admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.855770 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8a5c0-9dfa-4430-90a2-c1632e9a0d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.856048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8a5c0-9dfa-4430-90a2-c1632e9a0d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.856759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8a5c0-9dfa-4430-90a2-c1632e9a0d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.858435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8a5c0-9dfa-4430-90a2-c1632e9a0d5b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:44.868874 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1277/2591] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:44.869641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8a5c0-9dfa-4430-90a2-c1632e9a0d5b admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.871460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0dd8a5c0-9dfa-4430-90a2-c1632e9a0d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:44.884855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8a5c0-9dfa-4430-90a2-c1632e9a0d5b admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.890524 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d0ea2-417f-4718-a9cf-333786f5d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.891217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d0ea2-417f-4718-a9cf-333786f5d0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.896075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d0ea2-417f-4718-a9cf-333786f5d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.896075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d0ea2-417f-4718-a9cf-333786f5d0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.896075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d0ea2-417f-4718-a9cf-333786f5d0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.896075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d0ea2-417f-4718-a9cf-333786f5d0c5 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:44.903846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1278/2592] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:44.905003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d0ea2-417f-4718-a9cf-333786f5d0c5 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.913845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7ba82a80834a4aa098e9604165cfad'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:44.914725 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d0ea2-417f-4718-a9cf-333786f5d0c5 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:44.919453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53a362-0b5d-4d00-9096-8db8bd15769e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:44.920308 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53a362-0b5d-4d00-9096-8db8bd15769e admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:44.920596 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53a362-0b5d-4d00-9096-8db8bd15769e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:44.920880 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53a362-0b5d-4d00-9096-8db8bd15769e admin admin] PATH_INFO: `/v3/projects/7003c12cd03a40d4a992591a8be5cb9a/users/a836825076dc4a54a5b38aa3f2f9dca3/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:44.921209 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7ba82a80834a4aa098e9604165cfad'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:44.936078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53a362-0b5d-4d00-9096-8db8bd15769e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7003c12cd03a40d4a992591a8be5cb9a, user_id=a836825076dc4a54a5b38aa3f2f9dca3, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:44.941740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1315/2593] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:44 2022] DELETE /identity/v3/users/2e7ba82a80834a4aa098e9604165cfad => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:44.941740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:44.942005 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53a362-0b5d-4d00-9096-8db8bd15769e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.003973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77828e-5bea-4400-835f-11b88057dce1 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:45.008623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc7778-b10a-41ac-b9c7-498cfedf2903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:45.009292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc7778-b10a-41ac-b9c7-498cfedf2903 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.009577 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc7778-b10a-41ac-b9c7-498cfedf2903 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.009855 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc7778-b10a-41ac-b9c7-498cfedf2903 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.016849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc7778-b10a-41ac-b9c7-498cfedf2903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:45.016849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc7778-b10a-41ac-b9c7-498cfedf2903 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.022987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1316/2594] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:45.026660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc7778-b10a-41ac-b9c7-498cfedf2903 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.036349 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc7778-b10a-41ac-b9c7-498cfedf2903 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:45.041341 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77ae9b-ffaf-4ebc-9d32-ece8c5714bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:45.042246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ae9b-ffaf-4ebc-9d32-ece8c5714bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.042528 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ae9b-ffaf-4ebc-9d32-ece8c5714bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.042808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ae9b-ffaf-4ebc-9d32-ece8c5714bc4 admin admin] PATH_INFO: `/v3/projects/283df31f708f4428a65991fa890e4481/users/9bf4783f2e7b404bbc71a99f753f0303/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.047233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1279/2595] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:44 2022] PUT /identity/v3/projects/7003c12cd03a40d4a992591a8be5cb9a/users/a836825076dc4a54a5b38aa3f2f9dca3/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:45.065374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf73f1-ce65-476b-98f9-56589ce6efcf None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.065664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf73f1-ce65-476b-98f9-56589ce6efcf None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.065943 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf73f1-ce65-476b-98f9-56589ce6efcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.066694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77ae9b-ffaf-4ebc-9d32-ece8c5714bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=283df31f708f4428a65991fa890e4481, user_id=9bf4783f2e7b404bbc71a99f753f0303, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:45.069614 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77ae9b-ffaf-4ebc-9d32-ece8c5714bc4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.096215 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-dacf73f1-ce65-476b-98f9-56589ce6efcf None None] MFA Rules not processed for user `a836825076dc4a54a5b38aa3f2f9dca3`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:45.097491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-dacf73f1-ce65-476b-98f9-56589ce6efcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:45.161397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1280/2596] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:45.165864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf73f1-ce65-476b-98f9-56589ce6efcf None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.186049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1317/2597] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:45 2022] PUT /identity/v3/projects/283df31f708f4428a65991fa890e4481/users/9bf4783f2e7b404bbc71a99f753f0303/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:45.191253 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894fff1-ffcd-4838-8714-fa03905a610f None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.191544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894fff1-ffcd-4838-8714-fa03905a610f None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.191822 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894fff1-ffcd-4838-8714-fa03905a610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.209473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-a894fff1-ffcd-4838-8714-fa03905a610f None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:45.210892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a894fff1-ffcd-4838-8714-fa03905a610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:45.231551 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf73f1-ce65-476b-98f9-56589ce6efcf None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:45.245675 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:45.282426 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1318/2598] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:12:45.285630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894fff1-ffcd-4838-8714-fa03905a610f None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.285630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a894fff1-ffcd-4838-8714-fa03905a610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:45.293813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc22e1-e04b-4b15-9419-a4e63103a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:45.294506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc22e1-e04b-4b15-9419-a4e63103a9dd admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.294863 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc22e1-e04b-4b15-9419-a4e63103a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.295171 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc22e1-e04b-4b15-9419-a4e63103a9dd admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.295886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc22e1-e04b-4b15-9419-a4e63103a9dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:45.297240 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894fff1-ffcd-4838-8714-fa03905a610f None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:45.297818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc22e1-e04b-4b15-9419-a4e63103a9dd admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.301977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:45.302839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.303154 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.303427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] PATH_INFO: `/v3/projects/8db67f9819884a81a11772326e287481` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.304605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db67f9819884a81a11772326e287481)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:45.306506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.450383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1281/2599] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:45 2022] POST /identity/v3/projects => generated 389 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:45.451296 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc22e1-e04b-4b15-9419-a4e63103a9dd admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.452959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b3dc22e1-e04b-4b15-9419-a4e63103a9dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:45.477375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db67f9819884a81a11772326e287481', 'request_id': 'req-1f0bed81-7eae-4200-ad9b-b980bddcda53'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:45.482790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db67f9819884a81a11772326e287481', 'request_id': 'req-1f0bed81-7eae-4200-ad9b-b980bddcda53'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:45.489724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db67f9819884a81a11772326e287481', 'request_id': 'req-1f0bed81-7eae-4200-ad9b-b980bddcda53'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:45.512368 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc22e1-e04b-4b15-9419-a4e63103a9dd admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:45.559841 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1802ce2-9483-40e0-bfbb-bfde5a969b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:45.560497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1802ce2-9483-40e0-bfbb-bfde5a969b56 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.560785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1802ce2-9483-40e0-bfbb-bfde5a969b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.561066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1802ce2-9483-40e0-bfbb-bfde5a969b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.592637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:45.623441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1802ce2-9483-40e0-bfbb-bfde5a969b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:45.625355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1802ce2-9483-40e0-bfbb-bfde5a969b56 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.634834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1282/2600] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:45.635637 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1802ce2-9483-40e0-bfbb-bfde5a969b56 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.645297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] The token cache is being invalidate because project 8db67f9819884a81a11772326e287481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:45.645815 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:45.650771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-1f0bed81-7eae-4200-ad9b-b980bddcda53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:45.650771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1319/2601] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:45 2022] DELETE /identity/v3/projects/8db67f9819884a81a11772326e287481 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:45.651056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1802ce2-9483-40e0-bfbb-bfde5a969b56 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:45.653543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748d8e3-90d5-4312-abff-39cd1a493b0a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.656491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748d8e3-90d5-4312-abff-39cd1a493b0a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.656491 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748d8e3-90d5-4312-abff-39cd1a493b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.659309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a13a-a7b7-4c45-bac7-bcec808ad162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:45.659986 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a13a-a7b7-4c45-bac7-bcec808ad162 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.660279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a13a-a7b7-4c45-bac7-bcec808ad162 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.660552 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a13a-a7b7-4c45-bac7-bcec808ad162 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.661243 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6a13a-a7b7-4c45-bac7-bcec808ad162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:45.663305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6a13a-a7b7-4c45-bac7-bcec808ad162 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.676174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-c748d8e3-90d5-4312-abff-39cd1a493b0a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:45.677480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c748d8e3-90d5-4312-abff-39cd1a493b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:45.685802 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1320/2602] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:12:45.696720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625b002-dc29-419c-9764-a128b5ad96e7 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.696720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625b002-dc29-419c-9764-a128b5ad96e7 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.696720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625b002-dc29-419c-9764-a128b5ad96e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.712427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-5625b002-dc29-419c-9764-a128b5ad96e7 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:45.713574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5625b002-dc29-419c-9764-a128b5ad96e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:45.722665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1321/2603] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:12:45.727688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625b002-dc29-419c-9764-a128b5ad96e7 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.737892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625b002-dc29-419c-9764-a128b5ad96e7 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:45.742521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543d6f-1c50-4c44-a828-eea6ca9e7f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:45.743186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543d6f-1c50-4c44-a828-eea6ca9e7f0d admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.743471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543d6f-1c50-4c44-a828-eea6ca9e7f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.743749 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543d6f-1c50-4c44-a828-eea6ca9e7f0d admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.744486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b543d6f-1c50-4c44-a828-eea6ca9e7f0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:12:45.744855 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b543d6f-1c50-4c44-a828-eea6ca9e7f0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:45.746454 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b543d6f-1c50-4c44-a828-eea6ca9e7f0d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.758271 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1322/2604] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:12:45.762321 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543d6f-1c50-4c44-a828-eea6ca9e7f0d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.770535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1283/2605] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:45 2022] POST /identity/v3/users => generated 301 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:45.776893 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543d6f-1c50-4c44-a828-eea6ca9e7f0d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:45.777998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a13a-a7b7-4c45-bac7-bcec808ad162 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.779873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-43a6a13a-a7b7-4c45-bac7-bcec808ad162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:45.781390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c414-12dd-4bfe-a8c8-ca42c6d1995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:45.782164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c414-12dd-4bfe-a8c8-ca42c6d1995d admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.782450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c414-12dd-4bfe-a8c8-ca42c6d1995d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.782727 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c414-12dd-4bfe-a8c8-ca42c6d1995d admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.783469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988c414-12dd-4bfe-a8c8-ca42c6d1995d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:45.785373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988c414-12dd-4bfe-a8c8-ca42c6d1995d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.793452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a13a-a7b7-4c45-bac7-bcec808ad162 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:45.799818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe48b45-bb3c-46a4-a3be-5be56dc63293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:45.800510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe48b45-bb3c-46a4-a3be-5be56dc63293 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.800798 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe48b45-bb3c-46a4-a3be-5be56dc63293 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.801080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe48b45-bb3c-46a4-a3be-5be56dc63293 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.801825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe48b45-bb3c-46a4-a3be-5be56dc63293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:45.803762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe48b45-bb3c-46a4-a3be-5be56dc63293 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.814344 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1284/2606] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:45.818385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe48b45-bb3c-46a4-a3be-5be56dc63293 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.828239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe48b45-bb3c-46a4-a3be-5be56dc63293 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:45.832888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe312c-055f-4f45-bd61-b2f1aab53512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:45.833791 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe312c-055f-4f45-bd61-b2f1aab53512 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:45.834078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe312c-055f-4f45-bd61-b2f1aab53512 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:45.834359 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe312c-055f-4f45-bd61-b2f1aab53512 admin admin] PATH_INFO: `/v3/projects/cf017d2a8132449782d26eb3826e5614/users/b5aacb7224464d22ae723e430545b2fe/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:45.850762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe312c-055f-4f45-bd61-b2f1aab53512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf017d2a8132449782d26eb3826e5614, user_id=b5aacb7224464d22ae723e430545b2fe, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:45.853482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe312c-055f-4f45-bd61-b2f1aab53512 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:45.899622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1323/2607] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:45 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:45.903442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c414-12dd-4bfe-a8c8-ca42c6d1995d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.942993 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1285/2608] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:45 2022] PUT /identity/v3/projects/cf017d2a8132449782d26eb3826e5614/users/b5aacb7224464d22ae723e430545b2fe/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:45.955595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe312c-055f-4f45-bd61-b2f1aab53512 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:45.970828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c414-12dd-4bfe-a8c8-ca42c6d1995d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.026249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe312c-055f-4f45-bd61-b2f1aab53512 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.031090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8cc69-8379-4546-95b4-2f83f02c40c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.031758 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8cc69-8379-4546-95b4-2f83f02c40c1 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.032042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8cc69-8379-4546-95b4-2f83f02c40c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.032471 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8cc69-8379-4546-95b4-2f83f02c40c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.033278 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8cc69-8379-4546-95b4-2f83f02c40c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.034982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8cc69-8379-4546-95b4-2f83f02c40c1 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.041554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5fe29-c824-4767-9ea5-7f08b5c7fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.042212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5fe29-c824-4767-9ea5-7f08b5c7fd68 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.042496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5fe29-c824-4767-9ea5-7f08b5c7fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.042765 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5fe29-c824-4767-9ea5-7f08b5c7fd68 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.043479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5fe29-c824-4767-9ea5-7f08b5c7fd68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.045830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5fe29-c824-4767-9ea5-7f08b5c7fd68 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.047375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1286/2609] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:12:46.051541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8cc69-8379-4546-95b4-2f83f02c40c1 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:46.062260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8cc69-8379-4546-95b4-2f83f02c40c1 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.067249 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2962f2b-3a28-43d5-8f03-8dc4ac5c2de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.068333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2962f2b-3a28-43d5-8f03-8dc4ac5c2de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.068825 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2962f2b-3a28-43d5-8f03-8dc4ac5c2de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.069471 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2962f2b-3a28-43d5-8f03-8dc4ac5c2de1 admin admin] PATH_INFO: `/v3/projects/cf017d2a8132449782d26eb3826e5614/users/b5aacb7224464d22ae723e430545b2fe/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.071668 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2962f2b-3a28-43d5-8f03-8dc4ac5c2de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf017d2a8132449782d26eb3826e5614, user_id=b5aacb7224464d22ae723e430545b2fe, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.076837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2962f2b-3a28-43d5-8f03-8dc4ac5c2de1 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.084803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1287/2610] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:46 2022] PUT /identity/v3/projects/cf017d2a8132449782d26eb3826e5614/users/b5aacb7224464d22ae723e430545b2fe/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:46.097067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24b606-b2d3-409f-8797-2d2c65fb2394 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.097364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24b606-b2d3-409f-8797-2d2c65fb2394 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.097653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24b606-b2d3-409f-8797-2d2c65fb2394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.124565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-db24b606-b2d3-409f-8797-2d2c65fb2394 None None] MFA Rules not processed for user `b5aacb7224464d22ae723e430545b2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:46.126283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-db24b606-b2d3-409f-8797-2d2c65fb2394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:46.145433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:46.154355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1324/2611] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:45 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:46.155788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5fe29-c824-4767-9ea5-7f08b5c7fd68 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:46.171754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5fe29-c824-4767-9ea5-7f08b5c7fd68 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.210753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1288/2612] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:12:46.228125 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24b606-b2d3-409f-8797-2d2c65fb2394 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:46.229899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-db24b606-b2d3-409f-8797-2d2c65fb2394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:46.237249 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb715dc3-5fbb-46ff-93d3-a7428950a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.237941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb715dc3-5fbb-46ff-93d3-a7428950a425 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.238226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb715dc3-5fbb-46ff-93d3-a7428950a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.238605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb715dc3-5fbb-46ff-93d3-a7428950a425 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.239369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb715dc3-5fbb-46ff-93d3-a7428950a425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.241296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb715dc3-5fbb-46ff-93d3-a7428950a425 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.254884 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1325/2613] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:46.258782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb715dc3-5fbb-46ff-93d3-a7428950a425 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:46.269792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb715dc3-5fbb-46ff-93d3-a7428950a425 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.276112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a405928-795c-4999-9b14-9b6f5dd78c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.276911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405928-795c-4999-9b14-9b6f5dd78c15 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.277631 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405928-795c-4999-9b14-9b6f5dd78c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.278049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405928-795c-4999-9b14-9b6f5dd78c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.279142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a405928-795c-4999-9b14-9b6f5dd78c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.282081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a405928-795c-4999-9b14-9b6f5dd78c15 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.292267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24b606-b2d3-409f-8797-2d2c65fb2394 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.297864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243edaf-30d9-4215-ac9a-fbd858d4fa2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.298426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243edaf-30d9-4215-ac9a-fbd858d4fa2b service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.298689 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243edaf-30d9-4215-ac9a-fbd858d4fa2b service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.298982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243edaf-30d9-4215-ac9a-fbd858d4fa2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.301064 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1326/2614] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:12:46.301973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a405928-795c-4999-9b14-9b6f5dd78c15 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:46.309078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243edaf-30d9-4215-ac9a-fbd858d4fa2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.310557 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243edaf-30d9-4215-ac9a-fbd858d4fa2b service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.311877 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a405928-795c-4999-9b14-9b6f5dd78c15 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.317559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596da0a6-ebe9-4a84-a31b-c9b89eac01ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.318420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596da0a6-ebe9-4a84-a31b-c9b89eac01ed admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.318730 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596da0a6-ebe9-4a84-a31b-c9b89eac01ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.319029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596da0a6-ebe9-4a84-a31b-c9b89eac01ed admin admin] PATH_INFO: `/v3/projects/22f1f06acc7d4a19b4767870aca01886/users/16cd67ff81c847e2a541d9fb31f7df8a/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.320639 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1289/2615] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:46.334449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596da0a6-ebe9-4a84-a31b-c9b89eac01ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f1f06acc7d4a19b4767870aca01886, user_id=16cd67ff81c847e2a541d9fb31f7df8a, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.340325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596da0a6-ebe9-4a84-a31b-c9b89eac01ed admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.349122 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:46.451833 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1327/2616] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:46 2022] PUT /identity/v3/projects/22f1f06acc7d4a19b4767870aca01886/users/16cd67ff81c847e2a541d9fb31f7df8a/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:46.453280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243edaf-30d9-4215-ac9a-fbd858d4fa2b service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:46.458342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdf837-e72e-4bec-bd3d-3da5d663b9a4 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.458629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdf837-e72e-4bec-bd3d-3da5d663b9a4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.458901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdf837-e72e-4bec-bd3d-3da5d663b9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.467554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243edaf-30d9-4215-ac9a-fbd858d4fa2b service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.492301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-49fdf837-e72e-4bec-bd3d-3da5d663b9a4 None None] MFA Rules not processed for user `16cd67ff81c847e2a541d9fb31f7df8a`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:46.494252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-49fdf837-e72e-4bec-bd3d-3da5d663b9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:46.532943 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.533868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.534179 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.534457 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] PATH_INFO: `/v3/users/a836825076dc4a54a5b38aa3f2f9dca3` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.535802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a836825076dc4a54a5b38aa3f2f9dca3)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.537759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.574836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1328/2617] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:46.579431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdf837-e72e-4bec-bd3d-3da5d663b9a4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:46.590179 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdf837-e72e-4bec-bd3d-3da5d663b9a4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.595339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3afc7-5ec9-49df-815d-cb5566c895b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.595985 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3afc7-5ec9-49df-815d-cb5566c895b8 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.596274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3afc7-5ec9-49df-815d-cb5566c895b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.596550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3afc7-5ec9-49df-815d-cb5566c895b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.597230 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3afc7-5ec9-49df-815d-cb5566c895b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.599130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3afc7-5ec9-49df-815d-cb5566c895b8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.708296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1329/2618] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:46 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:46.712348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3afc7-5ec9-49df-815d-cb5566c895b8 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:46.716568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a836825076dc4a54a5b38aa3f2f9dca3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:46.717380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a836825076dc4a54a5b38aa3f2f9dca3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:46.718743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a836825076dc4a54a5b38aa3f2f9dca3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:46.726491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a836825076dc4a54a5b38aa3f2f9dca3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:46.741442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2903fa6b-40ea-45eb-a586-5174fa9d5325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a836825076dc4a54a5b38aa3f2f9dca3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:46.782166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3afc7-5ec9-49df-815d-cb5566c895b8 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.787124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cde61-92c4-4ec1-8a05-f62ad480a070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.787785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cde61-92c4-4ec1-8a05-f62ad480a070 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.788065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cde61-92c4-4ec1-8a05-f62ad480a070 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.788336 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cde61-92c4-4ec1-8a05-f62ad480a070 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.789013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cde61-92c4-4ec1-8a05-f62ad480a070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.790901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cde61-92c4-4ec1-8a05-f62ad480a070 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.865343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1290/2619] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:46 2022] DELETE /identity/v3/users/a836825076dc4a54a5b38aa3f2f9dca3 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:46.870390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04dbd0-0c96-44fc-8745-b63c353cfffc None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.870677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04dbd0-0c96-44fc-8745-b63c353cfffc None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.870956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04dbd0-0c96-44fc-8745-b63c353cfffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.889850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-ec04dbd0-0c96-44fc-8745-b63c353cfffc None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:46.891650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ec04dbd0-0c96-44fc-8745-b63c353cfffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:46.893600 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:46.902536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1330/2620] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:46 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:46.903938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cde61-92c4-4ec1-8a05-f62ad480a070 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:46.905632 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4b8cde61-92c4-4ec1-8a05-f62ad480a070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:46.917610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cde61-92c4-4ec1-8a05-f62ad480a070 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:46.953499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1291/2621] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:12:46.964995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04dbd0-0c96-44fc-8745-b63c353cfffc None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:46.966407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ec04dbd0-0c96-44fc-8745-b63c353cfffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:46.973739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598daf6a-4bde-4fca-b5f3-cdc8c6661cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:46.974412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598daf6a-4bde-4fca-b5f3-cdc8c6661cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:46.974694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598daf6a-4bde-4fca-b5f3-cdc8c6661cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:46.974992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598daf6a-4bde-4fca-b5f3-cdc8c6661cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:46.975761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598daf6a-4bde-4fca-b5f3-cdc8c6661cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:46.977351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598daf6a-4bde-4fca-b5f3-cdc8c6661cc5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:46.988145 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1331/2622] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:12:46.992264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598daf6a-4bde-4fca-b5f3-cdc8c6661cc5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:47.002849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598daf6a-4bde-4fca-b5f3-cdc8c6661cc5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:47.006420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:47.009125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa201151-1de1-40a8-9d42-880878ee9e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:47.009988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201151-1de1-40a8-9d42-880878ee9e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:47.010268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201151-1de1-40a8-9d42-880878ee9e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:47.011919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201151-1de1-40a8-9d42-880878ee9e16 admin admin] PATH_INFO: `/v3/projects/9f244663dbf34b0188679a48fb23c464/users/cf3e8c76bd9540b9a63924c376cbaabd/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:47.025957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04dbd0-0c96-44fc-8745-b63c353cfffc None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:47.026170 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa201151-1de1-40a8-9d42-880878ee9e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f244663dbf34b0188679a48fb23c464, user_id=cf3e8c76bd9540b9a63924c376cbaabd, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:47.028701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa201151-1de1-40a8-9d42-880878ee9e16 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:47.029768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf09ca-bcdc-40cd-9303-98b340825b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:47.031059 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf09ca-bcdc-40cd-9303-98b340825b4f service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:47.031722 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf09ca-bcdc-40cd-9303-98b340825b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:47.032091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf09ca-bcdc-40cd-9303-98b340825b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:47.041842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf09ca-bcdc-40cd-9303-98b340825b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:47.043419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf09ca-bcdc-40cd-9303-98b340825b4f service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:47.053839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1292/2623] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:12:47.161694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1332/2624] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:46 2022] PUT /identity/v3/projects/9f244663dbf34b0188679a48fb23c464/users/cf3e8c76bd9540b9a63924c376cbaabd/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:47.161813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf09ca-bcdc-40cd-9303-98b340825b4f service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:47.169659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf09ca-bcdc-40cd-9303-98b340825b4f service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:47.235666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a60f3-2cf0-4b82-bd2d-275949994c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:47.236351 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a60f3-2cf0-4b82-bd2d-275949994c2f admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:47.236635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a60f3-2cf0-4b82-bd2d-275949994c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:47.236917 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a60f3-2cf0-4b82-bd2d-275949994c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:47.237649 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a60f3-2cf0-4b82-bd2d-275949994c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:47.239403 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a60f3-2cf0-4b82-bd2d-275949994c2f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:47.250710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1293/2625] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:47.258767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa201151-1de1-40a8-9d42-880878ee9e16 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:47.265865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa201151-1de1-40a8-9d42-880878ee9e16 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:47.270633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25db219-7205-42ab-9f78-3299fb1fe2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:47.271563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25db219-7205-42ab-9f78-3299fb1fe2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:47.271846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25db219-7205-42ab-9f78-3299fb1fe2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:47.272123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25db219-7205-42ab-9f78-3299fb1fe2d7 admin admin] PATH_INFO: `/v3/projects/9f244663dbf34b0188679a48fb23c464/users/cf3e8c76bd9540b9a63924c376cbaabd/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:47.274147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25db219-7205-42ab-9f78-3299fb1fe2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f244663dbf34b0188679a48fb23c464, user_id=cf3e8c76bd9540b9a63924c376cbaabd, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:47.276848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25db219-7205-42ab-9f78-3299fb1fe2d7 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:47.289726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1333/2626] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:47 2022] PUT /identity/v3/projects/9f244663dbf34b0188679a48fb23c464/users/cf3e8c76bd9540b9a63924c376cbaabd/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:12:47.311777 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba1ed7-65bd-42ce-8840-8a44c5c9af6e None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:47.312138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba1ed7-65bd-42ce-8840-8a44c5c9af6e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:47.312343 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba1ed7-65bd-42ce-8840-8a44c5c9af6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:47.344716 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-94ba1ed7-65bd-42ce-8840-8a44c5c9af6e None None] MFA Rules not processed for user `cf3e8c76bd9540b9a63924c376cbaabd`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:47.346407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-94ba1ed7-65bd-42ce-8840-8a44c5c9af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:47.424456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1294/2627] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:47.437146 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25db219-7205-42ab-9f78-3299fb1fe2d7 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:47.439273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f25db219-7205-42ab-9f78-3299fb1fe2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:47.502561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25db219-7205-42ab-9f78-3299fb1fe2d7 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:47.506348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1ea59-39a6-452d-b6cb-fedc727772aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:47.507027 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ea59-39a6-452d-b6cb-fedc727772aa service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:47.507311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ea59-39a6-452d-b6cb-fedc727772aa service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:47.507584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1ea59-39a6-452d-b6cb-fedc727772aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:47.517633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1ea59-39a6-452d-b6cb-fedc727772aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:47.519118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1ea59-39a6-452d-b6cb-fedc727772aa service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:47.529375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1334/2628] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:47.688070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba1ed7-65bd-42ce-8840-8a44c5c9af6e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:47.689570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-94ba1ed7-65bd-42ce-8840-8a44c5c9af6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:47.704774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1ea59-39a6-452d-b6cb-fedc727772aa service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:47.706475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6ec1ea59-39a6-452d-b6cb-fedc727772aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:47.720659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1ea59-39a6-452d-b6cb-fedc727772aa service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:47.726773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00d168-5f30-4ec1-b890-f95722a4d4ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:47.728173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00d168-5f30-4ec1-b890-f95722a4d4ea service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:47.731918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00d168-5f30-4ec1-b890-f95722a4d4ea service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:47.731918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00d168-5f30-4ec1-b890-f95722a4d4ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:47.731918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ee00d168-5f30-4ec1-b890-f95722a4d4ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:47.753690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:47.785976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba1ed7-65bd-42ce-8840-8a44c5c9af6e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:47.793621 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:47.794526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:47.798165 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:47.798165 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] PATH_INFO: `/v3/projects/7003c12cd03a40d4a992591a8be5cb9a` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:47.798165 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7003c12cd03a40d4a992591a8be5cb9a)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:47.799254 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:47.810926 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00d168-5f30-4ec1-b890-f95722a4d4ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:47.813010 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00d168-5f30-4ec1-b890-f95722a4d4ea service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:47.824166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1335/2629] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:12:47.933593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7003c12cd03a40d4a992591a8be5cb9a', 'request_id': 'req-b126feb1-8a8e-4d40-b213-cc16cfc818c1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:47.941976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7003c12cd03a40d4a992591a8be5cb9a', 'request_id': 'req-b126feb1-8a8e-4d40-b213-cc16cfc818c1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:47.951018 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7003c12cd03a40d4a992591a8be5cb9a', 'request_id': 'req-b126feb1-8a8e-4d40-b213-cc16cfc818c1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:48.028776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] The token cache is being invalidate because project 7003c12cd03a40d4a992591a8be5cb9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:48.028776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:48.028776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:48.028776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1295/2630] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:47 2022] DELETE /identity/v3/projects/7003c12cd03a40d4a992591a8be5cb9a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:48.032785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00d168-5f30-4ec1-b890-f95722a4d4ea service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:48.045051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00d168-5f30-4ec1-b890-f95722a4d4ea service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:48.125618 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:48.126511 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:48.126805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:48.127119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] PATH_INFO: `/v3/users/b5aacb7224464d22ae723e430545b2fe` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:48.128369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5aacb7224464d22ae723e430545b2fe)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:48.130523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:48.323792 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:48.432856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5aacb7224464d22ae723e430545b2fe'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:48.433540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5aacb7224464d22ae723e430545b2fe'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:48.434150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5aacb7224464d22ae723e430545b2fe'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:48.523210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5aacb7224464d22ae723e430545b2fe'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:48.536405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-5a5f6680-fed8-4e9c-9821-d755dda0030d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5aacb7224464d22ae723e430545b2fe'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:48.554809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1336/2631] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:48 2022] DELETE /identity/v3/users/b5aacb7224464d22ae723e430545b2fe => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:48.752235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:49.047678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:49.050654 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:49.066769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126feb1-8a8e-4d40-b213-cc16cfc818c1 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:49.141033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:49.141916 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:49.142199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:49.142476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] PATH_INFO: `/v3/projects/cf017d2a8132449782d26eb3826e5614` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:49.143721 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf017d2a8132449782d26eb3826e5614)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:49.145655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:49.311230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf017d2a8132449782d26eb3826e5614', 'request_id': 'req-f276cad8-4a06-4915-a4fa-765107cd474e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:49.322914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf017d2a8132449782d26eb3826e5614', 'request_id': 'req-f276cad8-4a06-4915-a4fa-765107cd474e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:49.334693 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf017d2a8132449782d26eb3826e5614', 'request_id': 'req-f276cad8-4a06-4915-a4fa-765107cd474e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:49.452857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] The token cache is being invalidate because project cf017d2a8132449782d26eb3826e5614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:49.453314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:49.453979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-f276cad8-4a06-4915-a4fa-765107cd474e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:49.456192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1296/2632] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:49 2022] DELETE /identity/v3/projects/cf017d2a8132449782d26eb3826e5614 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:49.460782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58b5d7-18d9-4b23-8061-69adf268f342 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:49.461074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58b5d7-18d9-4b23-8061-69adf268f342 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:49.461377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58b5d7-18d9-4b23-8061-69adf268f342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:49.480533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-8e58b5d7-18d9-4b23-8061-69adf268f342 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:49.481741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8e58b5d7-18d9-4b23-8061-69adf268f342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:49.502099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:49.546955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1337/2633] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:49.554984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485126f-2686-4bc8-b54b-a592b4ea8f03 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:49.555280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485126f-2686-4bc8-b54b-a592b4ea8f03 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:49.555565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485126f-2686-4bc8-b54b-a592b4ea8f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:49.580533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8485126f-2686-4bc8-b54b-a592b4ea8f03 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:49.583112 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8485126f-2686-4bc8-b54b-a592b4ea8f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:49.596679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1297/2634] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:49.597776 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58b5d7-18d9-4b23-8061-69adf268f342 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:49.608129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58b5d7-18d9-4b23-8061-69adf268f342 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:49.613600 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b66ea-b581-405c-803a-bae2017a309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:49.614268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b66ea-b581-405c-803a-bae2017a309b admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:49.614557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b66ea-b581-405c-803a-bae2017a309b admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:49.614838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b66ea-b581-405c-803a-bae2017a309b admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:49.615724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b66ea-b581-405c-803a-bae2017a309b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:12:49.616035 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b66ea-b581-405c-803a-bae2017a309b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:49.619217 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b66ea-b581-405c-803a-bae2017a309b admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:49.637272 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1338/2635] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:12:49.638548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485126f-2686-4bc8-b54b-a592b4ea8f03 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:49.662876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485126f-2686-4bc8-b54b-a592b4ea8f03 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:49.674588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15123b33-5ede-4354-a5ec-f5e02c2b4f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:49.677878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15123b33-5ede-4354-a5ec-f5e02c2b4f5d admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:49.677878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15123b33-5ede-4354-a5ec-f5e02c2b4f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:49.678117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15123b33-5ede-4354-a5ec-f5e02c2b4f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:49.678857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15123b33-5ede-4354-a5ec-f5e02c2b4f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:49.682525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15123b33-5ede-4354-a5ec-f5e02c2b4f5d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:49.792098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1298/2636] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:49 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:49.794118 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b66ea-b581-405c-803a-bae2017a309b admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:49.808853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b66ea-b581-405c-803a-bae2017a309b admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:49.876742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c033bf0-8c4a-422d-a9af-a956a0b13060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:49.877527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c033bf0-8c4a-422d-a9af-a956a0b13060 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:49.877812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c033bf0-8c4a-422d-a9af-a956a0b13060 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:49.878133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c033bf0-8c4a-422d-a9af-a956a0b13060 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:49.879013 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c033bf0-8c4a-422d-a9af-a956a0b13060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:49.881107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c033bf0-8c4a-422d-a9af-a956a0b13060 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:49.985153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1339/2637] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:49 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:49.989257 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15123b33-5ede-4354-a5ec-f5e02c2b4f5d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:50.001871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15123b33-5ede-4354-a5ec-f5e02c2b4f5d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:50.013230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e90183-a262-4da5-84c2-17b99ae0031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:50.014136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e90183-a262-4da5-84c2-17b99ae0031f admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:50.014603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e90183-a262-4da5-84c2-17b99ae0031f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:50.015121 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e90183-a262-4da5-84c2-17b99ae0031f admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:50.016041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e90183-a262-4da5-84c2-17b99ae0031f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:50.018248 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e90183-a262-4da5-84c2-17b99ae0031f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:50.031913 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1299/2638] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:50.035831 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c033bf0-8c4a-422d-a9af-a956a0b13060 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:50.048129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c033bf0-8c4a-422d-a9af-a956a0b13060 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:50.057413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d0d84-6df5-44d0-8388-a3341afdf096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:50.057413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d0d84-6df5-44d0-8388-a3341afdf096 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:50.057413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d0d84-6df5-44d0-8388-a3341afdf096 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:50.057413 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d0d84-6df5-44d0-8388-a3341afdf096 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:50.057818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d0d84-6df5-44d0-8388-a3341afdf096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:50.058358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d0d84-6df5-44d0-8388-a3341afdf096 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:50.071486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1340/2639] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:50.075549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e90183-a262-4da5-84c2-17b99ae0031f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:50.090288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e90183-a262-4da5-84c2-17b99ae0031f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:50.098160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cafab2-cd5d-4d98-a449-3a630aa4ae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:50.100267 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cafab2-cd5d-4d98-a449-3a630aa4ae81 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:50.100656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cafab2-cd5d-4d98-a449-3a630aa4ae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:50.101048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cafab2-cd5d-4d98-a449-3a630aa4ae81 admin admin] PATH_INFO: `/v3/projects/2ead526b3fb9470f8edf3c938464533f/users/bf8da46ffef046d0a54fbd51ab2aa9c1/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:50.121649 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cafab2-cd5d-4d98-a449-3a630aa4ae81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ead526b3fb9470f8edf3c938464533f, user_id=bf8da46ffef046d0a54fbd51ab2aa9c1, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:50.124641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cafab2-cd5d-4d98-a449-3a630aa4ae81 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:50.202569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1300/2640] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:50 2022] PUT /identity/v3/projects/2ead526b3fb9470f8edf3c938464533f/users/bf8da46ffef046d0a54fbd51ab2aa9c1/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:50.206066 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6aada-31cf-4d17-8c47-caa25e8c7840 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:50.208854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6aada-31cf-4d17-8c47-caa25e8c7840 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:50.208854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6aada-31cf-4d17-8c47-caa25e8c7840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:50.234192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-51e6aada-31cf-4d17-8c47-caa25e8c7840 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:50.236506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-51e6aada-31cf-4d17-8c47-caa25e8c7840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:50.320453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1341/2641] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:50.331177 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cafab2-cd5d-4d98-a449-3a630aa4ae81 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:50.333398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-47cafab2-cd5d-4d98-a449-3a630aa4ae81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:50.404737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cafab2-cd5d-4d98-a449-3a630aa4ae81 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:50.409079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be8755-b1c3-4409-a5dd-62c104a2340c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:50.410061 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be8755-b1c3-4409-a5dd-62c104a2340c service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:50.410509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be8755-b1c3-4409-a5dd-62c104a2340c service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:50.410782 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be8755-b1c3-4409-a5dd-62c104a2340c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:50.420522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be8755-b1c3-4409-a5dd-62c104a2340c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:50.422575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be8755-b1c3-4409-a5dd-62c104a2340c service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:50.432543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1301/2642] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:50.958271 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:51.005333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:51.803994 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:51.893453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4a0ec-44ca-4343-a1b4-bfff4f42bdeb None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:51.894018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4a0ec-44ca-4343-a1b4-bfff4f42bdeb None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:51.894477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4a0ec-44ca-4343-a1b4-bfff4f42bdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:51.935701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-26a4a0ec-44ca-4343-a1b4-bfff4f42bdeb None None] MFA Rules not processed for user `9bf4783f2e7b404bbc71a99f753f0303`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:51.937623 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-26a4a0ec-44ca-4343-a1b4-bfff4f42bdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:52.033166 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1d70b-8dbe-4cdc-be10-f42e28cbdf9a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.033708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1d70b-8dbe-4cdc-be10-f42e28cbdf9a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.038317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1d70b-8dbe-4cdc-be10-f42e28cbdf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.038667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1342/2643] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:52.046759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4a0ec-44ca-4343-a1b4-bfff4f42bdeb None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:52.046759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-26a4a0ec-44ca-4343-a1b4-bfff4f42bdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:52.063763 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4a0ec-44ca-4343-a1b4-bfff4f42bdeb None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:52.070282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab58772-3ba3-4eff-a112-67ad8087ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:52.071109 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab58772-3ba3-4eff-a112-67ad8087ec10 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.071467 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab58772-3ba3-4eff-a112-67ad8087ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.071813 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab58772-3ba3-4eff-a112-67ad8087ec10 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.072938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab58772-3ba3-4eff-a112-67ad8087ec10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:52.076368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab58772-3ba3-4eff-a112-67ad8087ec10 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:52.105330 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-12c1d70b-8dbe-4cdc-be10-f42e28cbdf9a None None] MFA Rules not processed for user `bf8da46ffef046d0a54fbd51ab2aa9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:52.106718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-12c1d70b-8dbe-4cdc-be10-f42e28cbdf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:52.181712 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1302/2644] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:52.208302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1d70b-8dbe-4cdc-be10-f42e28cbdf9a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:52.220947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1d70b-8dbe-4cdc-be10-f42e28cbdf9a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:52.227255 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fb6c8-53dc-46d8-b44d-97de3eb6856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:52.228885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fb6c8-53dc-46d8-b44d-97de3eb6856e admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.229175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fb6c8-53dc-46d8-b44d-97de3eb6856e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.229453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fb6c8-53dc-46d8-b44d-97de3eb6856e admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.230158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1fb6c8-53dc-46d8-b44d-97de3eb6856e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:52.232509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1fb6c8-53dc-46d8-b44d-97de3eb6856e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:52.267690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1343/2645] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:52 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:52.290742 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab58772-3ba3-4eff-a112-67ad8087ec10 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:52.365743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab58772-3ba3-4eff-a112-67ad8087ec10 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:52.371984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffd5f3-3c21-4ceb-882d-a8f19968cd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:52.372189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffd5f3-3c21-4ceb-882d-a8f19968cd01 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.372570 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffd5f3-3c21-4ceb-882d-a8f19968cd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.372972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ffd5f3-3c21-4ceb-882d-a8f19968cd01 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.373767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffd5f3-3c21-4ceb-882d-a8f19968cd01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:52.376756 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ffd5f3-3c21-4ceb-882d-a8f19968cd01 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:52.438159 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1303/2646] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:52 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:52.440573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fb6c8-53dc-46d8-b44d-97de3eb6856e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:52.504018 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fb6c8-53dc-46d8-b44d-97de3eb6856e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:52.508711 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03859ddd-1f57-46c3-9bcc-6dc6d9f42101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:52.509373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859ddd-1f57-46c3-9bcc-6dc6d9f42101 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.509655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859ddd-1f57-46c3-9bcc-6dc6d9f42101 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.510032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03859ddd-1f57-46c3-9bcc-6dc6d9f42101 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.510757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03859ddd-1f57-46c3-9bcc-6dc6d9f42101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:52.512706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03859ddd-1f57-46c3-9bcc-6dc6d9f42101 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:52.558358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1344/2647] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:52 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:52.562986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffd5f3-3c21-4ceb-882d-a8f19968cd01 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:52.575011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ffd5f3-3c21-4ceb-882d-a8f19968cd01 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:52.580520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8e466-adb1-4617-b148-179640662e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:52.581429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8e466-adb1-4617-b148-179640662e76 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.581777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8e466-adb1-4617-b148-179640662e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.582141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8e466-adb1-4617-b148-179640662e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.582875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8e466-adb1-4617-b148-179640662e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:52.584595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8e466-adb1-4617-b148-179640662e76 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:52.599239 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1345/2648] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:12:52.600304 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8e466-adb1-4617-b148-179640662e76 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:52.610744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8e466-adb1-4617-b148-179640662e76 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:52.615559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58779548-0d9b-4fa0-a8b9-02d707f3ab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:52.616559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58779548-0d9b-4fa0-a8b9-02d707f3ab9e admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.616700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58779548-0d9b-4fa0-a8b9-02d707f3ab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.616970 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58779548-0d9b-4fa0-a8b9-02d707f3ab9e admin admin] PATH_INFO: `/v3/projects/22cb5a8bd98048c58c31f4aeb0409f7b/users/854568777d1849579f2f812c28842bb3/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.632587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58779548-0d9b-4fa0-a8b9-02d707f3ab9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cb5a8bd98048c58c31f4aeb0409f7b, user_id=854568777d1849579f2f812c28842bb3, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:52.635260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58779548-0d9b-4fa0-a8b9-02d707f3ab9e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:52.690937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1304/2649] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:52 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:52.694856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03859ddd-1f57-46c3-9bcc-6dc6d9f42101 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:52.705236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03859ddd-1f57-46c3-9bcc-6dc6d9f42101 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:52.711553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad706c5-c79f-4cf4-bd8f-93c627bca43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:52.716113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad706c5-c79f-4cf4-bd8f-93c627bca43d admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.716606 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad706c5-c79f-4cf4-bd8f-93c627bca43d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.717034 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad706c5-c79f-4cf4-bd8f-93c627bca43d admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.717945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad706c5-c79f-4cf4-bd8f-93c627bca43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:52.719760 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad706c5-c79f-4cf4-bd8f-93c627bca43d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:52.720453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1346/2650] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:52 2022] PUT /identity/v3/projects/22cb5a8bd98048c58c31f4aeb0409f7b/users/854568777d1849579f2f812c28842bb3/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:52.725203 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58779548-0d9b-4fa0-a8b9-02d707f3ab9e admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:52.735117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1305/2651] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:12:52.738455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad706c5-c79f-4cf4-bd8f-93c627bca43d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:52.748753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad706c5-c79f-4cf4-bd8f-93c627bca43d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:52.792937 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58779548-0d9b-4fa0-a8b9-02d707f3ab9e admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:52.798581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ef08-3896-415e-969b-8c288ee77bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:52.799291 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ef08-3896-415e-969b-8c288ee77bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.799591 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ef08-3896-415e-969b-8c288ee77bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.799881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37ef08-3896-415e-969b-8c288ee77bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.800601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37ef08-3896-415e-969b-8c288ee77bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:52.802206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37ef08-3896-415e-969b-8c288ee77bc5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:52.805839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef4630-4478-4335-a4f5-b48dbb31a5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:52.806815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef4630-4478-4335-a4f5-b48dbb31a5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.807246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef4630-4478-4335-a4f5-b48dbb31a5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.807644 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef4630-4478-4335-a4f5-b48dbb31a5e9 admin admin] PATH_INFO: `/v3/projects/ce19b607b7a04b8baf22a01cd809d233/users/b3da33f4b05542629ee61b863d313e44/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.820972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1347/2652] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:12:52.822223 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ef08-3896-415e-969b-8c288ee77bc5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:52.826285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef4630-4478-4335-a4f5-b48dbb31a5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce19b607b7a04b8baf22a01cd809d233, user_id=b3da33f4b05542629ee61b863d313e44, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:52.830990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef4630-4478-4335-a4f5-b48dbb31a5e9 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:52.833243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37ef08-3896-415e-969b-8c288ee77bc5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:52.838944 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba601201-a4de-401c-8e10-72d7d38b410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:52.840303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601201-a4de-401c-8e10-72d7d38b410f admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:52.840588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601201-a4de-401c-8e10-72d7d38b410f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:52.840865 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601201-a4de-401c-8e10-72d7d38b410f admin admin] PATH_INFO: `/v3/projects/22cb5a8bd98048c58c31f4aeb0409f7b/users/854568777d1849579f2f812c28842bb3/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:52.842920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba601201-a4de-401c-8e10-72d7d38b410f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cb5a8bd98048c58c31f4aeb0409f7b, user_id=854568777d1849579f2f812c28842bb3, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:52.845942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba601201-a4de-401c-8e10-72d7d38b410f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:52.856630 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1348/2653] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:52 2022] PUT /identity/v3/projects/22cb5a8bd98048c58c31f4aeb0409f7b/users/854568777d1849579f2f812c28842bb3/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:52.937775 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1306/2654] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:52 2022] PUT /identity/v3/projects/ce19b607b7a04b8baf22a01cd809d233/users/b3da33f4b05542629ee61b863d313e44/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:52.942028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba601201-a4de-401c-8e10-72d7d38b410f admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:53.006697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba601201-a4de-401c-8e10-72d7d38b410f admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:53.087799 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde4d98-1028-45a9-bc50-d8d9ac2b08bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:53.088592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde4d98-1028-45a9-bc50-d8d9ac2b08bf admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:53.088877 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde4d98-1028-45a9-bc50-d8d9ac2b08bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:53.089149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde4d98-1028-45a9-bc50-d8d9ac2b08bf admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:53.090138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde4d98-1028-45a9-bc50-d8d9ac2b08bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:53.094152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde4d98-1028-45a9-bc50-d8d9ac2b08bf admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:53.109597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1349/2655] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:53.113762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef4630-4478-4335-a4f5-b48dbb31a5e9 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:53.125247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef4630-4478-4335-a4f5-b48dbb31a5e9 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:53.130864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16cf57-e634-4f33-9aba-48b0f38bf26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:53.131799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16cf57-e634-4f33-9aba-48b0f38bf26d admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:53.132084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16cf57-e634-4f33-9aba-48b0f38bf26d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:53.132364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16cf57-e634-4f33-9aba-48b0f38bf26d admin admin] PATH_INFO: `/v3/projects/ce19b607b7a04b8baf22a01cd809d233/users/b3da33f4b05542629ee61b863d313e44/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:53.134950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16cf57-e634-4f33-9aba-48b0f38bf26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce19b607b7a04b8baf22a01cd809d233, user_id=b3da33f4b05542629ee61b863d313e44, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:53.137650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff16cf57-e634-4f33-9aba-48b0f38bf26d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:53.148464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1307/2656] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:53 2022] PUT /identity/v3/projects/ce19b607b7a04b8baf22a01cd809d233/users/b3da33f4b05542629ee61b863d313e44/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:53.885740 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde4d98-1028-45a9-bc50-d8d9ac2b08bf admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:53.887629 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-4dde4d98-1028-45a9-bc50-d8d9ac2b08bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:53.901049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde4d98-1028-45a9-bc50-d8d9ac2b08bf admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:53.985072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:53.985975 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:53.986269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:53.986604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] PATH_INFO: `/v3/users/16cd67ff81c847e2a541d9fb31f7df8a` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:53.988001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16cd67ff81c847e2a541d9fb31f7df8a)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:53.990254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:54.034372 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:54.284795 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16cd67ff81c847e2a541d9fb31f7df8a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:54.286828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16cd67ff81c847e2a541d9fb31f7df8a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:54.288595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16cd67ff81c847e2a541d9fb31f7df8a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:54.383988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16cd67ff81c847e2a541d9fb31f7df8a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:54.398998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16cd67ff81c847e2a541d9fb31f7df8a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:54.450337 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1350/2657] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:53 2022] DELETE /identity/v3/users/16cd67ff81c847e2a541d9fb31f7df8a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:54.453226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37808f-b9cb-42e9-ba6d-1900989395db None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:54.454496 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37808f-b9cb-42e9-ba6d-1900989395db None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:54.454925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37808f-b9cb-42e9-ba6d-1900989395db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:54.488109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-bd37808f-b9cb-42e9-ba6d-1900989395db None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:54.494398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-bd37808f-b9cb-42e9-ba6d-1900989395db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:54.594821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1308/2658] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:54.606942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:54.609075 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:54.717439 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dc582-d5fd-4ac4-b9f4-41808ceba3e8 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:54.722556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbe46c-80db-4b95-ae80-ed677184df81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:54.723323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe46c-80db-4b95-ae80-ed677184df81 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:54.723628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe46c-80db-4b95-ae80-ed677184df81 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:54.724181 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbe46c-80db-4b95-ae80-ed677184df81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:54.735506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbe46c-80db-4b95-ae80-ed677184df81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:54.737171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbe46c-80db-4b95-ae80-ed677184df81 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:54.751262 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1351/2659] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:55.001173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:55.254190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b10da-78f7-4ad8-b4cd-c9b127d1a3b7 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:55.254473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b10da-78f7-4ad8-b4cd-c9b127d1a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:55.254746 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b10da-78f7-4ad8-b4cd-c9b127d1a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:55.289099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbe46c-80db-4b95-ae80-ed677184df81 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:55.291335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c6cbe46c-80db-4b95-ae80-ed677184df81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:55.294380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-e76b10da-78f7-4ad8-b4cd-c9b127d1a3b7 None None] MFA Rules not processed for user `b3da33f4b05542629ee61b863d313e44`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:55.295745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e76b10da-78f7-4ad8-b4cd-c9b127d1a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:55.323686 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbe46c-80db-4b95-ae80-ed677184df81 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:55.329736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:55.330942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:55.331384 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:55.331983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] PATH_INFO: `/v3/projects/22f1f06acc7d4a19b4767870aca01886` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:55.333548 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f1f06acc7d4a19b4767870aca01886)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:55.335688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:55.441058 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1309/2660] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:55.454047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b10da-78f7-4ad8-b4cd-c9b127d1a3b7 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:55.455905 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e76b10da-78f7-4ad8-b4cd-c9b127d1a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:55.487509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f1f06acc7d4a19b4767870aca01886', 'request_id': 'req-260a76bd-3313-42a1-851a-cfd6df36e97d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:55.493529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f1f06acc7d4a19b4767870aca01886', 'request_id': 'req-260a76bd-3313-42a1-851a-cfd6df36e97d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:55.508414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f1f06acc7d4a19b4767870aca01886', 'request_id': 'req-260a76bd-3313-42a1-851a-cfd6df36e97d'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:55.542400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b10da-78f7-4ad8-b4cd-c9b127d1a3b7 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:55.605280 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bc2df-77fd-4539-af43-31969dede1a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:55.605945 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bc2df-77fd-4539-af43-31969dede1a9 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:55.606236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bc2df-77fd-4539-af43-31969dede1a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:55.606519 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bc2df-77fd-4539-af43-31969dede1a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:55.608976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e95bc2df-77fd-4539-af43-31969dede1a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:55.637111 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] The token cache is being invalidate because project 22f1f06acc7d4a19b4767870aca01886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:55.637657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:55.640328 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:55.642148 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1352/2661] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:55 2022] DELETE /identity/v3/projects/22f1f06acc7d4a19b4767870aca01886 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:55.645906 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:55.647807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:55.695350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bc2df-77fd-4539-af43-31969dede1a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:55.697347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bc2df-77fd-4539-af43-31969dede1a9 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:55.713093 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1310/2662] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:12:55.745156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a76bd-3313-42a1-851a-cfd6df36e97d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:55.754286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:55.755236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:55.755525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:55.755800 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] PATH_INFO: `/v3/users/cf3e8c76bd9540b9a63924c376cbaabd` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:55.757059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3e8c76bd9540b9a63924c376cbaabd)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:55.759032 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:56.112650 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3e8c76bd9540b9a63924c376cbaabd'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:56.113581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3e8c76bd9540b9a63924c376cbaabd'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:56.114378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3e8c76bd9540b9a63924c376cbaabd'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:56.217056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3e8c76bd9540b9a63924c376cbaabd'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:56.232268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ca89b400-543a-4393-a5a5-1ada7d295063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3e8c76bd9540b9a63924c376cbaabd'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:56.271323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1353/2663] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:55 2022] DELETE /identity/v3/users/cf3e8c76bd9540b9a63924c376cbaabd => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:57.001578 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bc2df-77fd-4539-af43-31969dede1a9 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:57.012672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bc2df-77fd-4539-af43-31969dede1a9 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:57.073514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:57.074379 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:57.074665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:57.074948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] PATH_INFO: `/v3/projects/9f244663dbf34b0188679a48fb23c464` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:57.076164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f244663dbf34b0188679a48fb23c464)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:57.078425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:57.245706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f244663dbf34b0188679a48fb23c464', 'request_id': 'req-588a5069-f171-4d2b-b2e7-1109372bb7e5'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:57.252491 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f244663dbf34b0188679a48fb23c464', 'request_id': 'req-588a5069-f171-4d2b-b2e7-1109372bb7e5'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:57.259080 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f244663dbf34b0188679a48fb23c464', 'request_id': 'req-588a5069-f171-4d2b-b2e7-1109372bb7e5'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:57.375875 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:57.382210 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] The token cache is being invalidate because project 9f244663dbf34b0188679a48fb23c464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:12:57.382773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:57.383492 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-588a5069-f171-4d2b-b2e7-1109372bb7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:57.385400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1311/2664] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:12:57 2022] DELETE /identity/v3/projects/9f244663dbf34b0188679a48fb23c464 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:57.391178 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d24fc3-5e10-493c-819e-1735202ab3e3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:57.391471 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d24fc3-5e10-493c-819e-1735202ab3e3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:57.391952 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d24fc3-5e10-493c-819e-1735202ab3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:57.423351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-f5d24fc3-5e10-493c-819e-1735202ab3e3 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:57.431681 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f5d24fc3-5e10-493c-819e-1735202ab3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:57.498782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1354/2665] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:57.507044 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9243-a210-4f06-9732-945fe75bf8b6 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:57.507647 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9243-a210-4f06-9732-945fe75bf8b6 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:57.508145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff9243-a210-4f06-9732-945fe75bf8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:57.528006 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-c2ff9243-a210-4f06-9732-945fe75bf8b6 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:57.529314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c2ff9243-a210-4f06-9732-945fe75bf8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:57.538098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1312/2666] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:57.542351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d24fc3-5e10-493c-819e-1735202ab3e3 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:57.552496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d24fc3-5e10-493c-819e-1735202ab3e3 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:57.557211 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacc5e3-6203-411d-a5e4-7ae48493d311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:57.557873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacc5e3-6203-411d-a5e4-7ae48493d311 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:57.558208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacc5e3-6203-411d-a5e4-7ae48493d311 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:57.558437 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacc5e3-6203-411d-a5e4-7ae48493d311 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:57.559195 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacc5e3-6203-411d-a5e4-7ae48493d311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:12:57.559504 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacc5e3-6203-411d-a5e4-7ae48493d311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:57.561097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacc5e3-6203-411d-a5e4-7ae48493d311 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:57.573369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1355/2667] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:12:57.578625 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff9243-a210-4f06-9732-945fe75bf8b6 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:57.587723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff9243-a210-4f06-9732-945fe75bf8b6 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:57.592935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbcae5-cf48-46bc-b6ee-7c40f2f433d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:57.593682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbcae5-cf48-46bc-b6ee-7c40f2f433d4 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:57.593967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbcae5-cf48-46bc-b6ee-7c40f2f433d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:57.594241 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbcae5-cf48-46bc-b6ee-7c40f2f433d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:57.594929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbcae5-cf48-46bc-b6ee-7c40f2f433d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:57.596941 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbcae5-cf48-46bc-b6ee-7c40f2f433d4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:57.766744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1313/2668] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:57 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:57.771037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacc5e3-6203-411d-a5e4-7ae48493d311 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:57.784951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacc5e3-6203-411d-a5e4-7ae48493d311 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:57.856816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018286e-6e03-4f67-a327-9ca948b96f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:57.857509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018286e-6e03-4f67-a327-9ca948b96f07 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:57.858026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018286e-6e03-4f67-a327-9ca948b96f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:57.858026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018286e-6e03-4f67-a327-9ca948b96f07 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:57.858762 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018286e-6e03-4f67-a327-9ca948b96f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:57.860886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018286e-6e03-4f67-a327-9ca948b96f07 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:58.029411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1356/2669] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:57 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:12:58.033375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbcae5-cf48-46bc-b6ee-7c40f2f433d4 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:58.043594 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:58.048660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbcae5-cf48-46bc-b6ee-7c40f2f433d4 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:58.053900 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664bdac-6ef3-416b-a9bf-6028adbe2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:58.054574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664bdac-6ef3-416b-a9bf-6028adbe2097 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:58.054858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664bdac-6ef3-416b-a9bf-6028adbe2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:58.055159 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664bdac-6ef3-416b-a9bf-6028adbe2097 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:58.055886 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664bdac-6ef3-416b-a9bf-6028adbe2097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:58.058098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664bdac-6ef3-416b-a9bf-6028adbe2097 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:58.074571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1314/2670] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:58.078867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018286e-6e03-4f67-a327-9ca948b96f07 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:58.090335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018286e-6e03-4f67-a327-9ca948b96f07 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:58.095803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d73657-eafc-4bf7-b453-3490767a3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:58.096841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d73657-eafc-4bf7-b453-3490767a3567 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:58.097343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d73657-eafc-4bf7-b453-3490767a3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:58.097911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d73657-eafc-4bf7-b453-3490767a3567 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:58.100063 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d73657-eafc-4bf7-b453-3490767a3567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:58.100999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d73657-eafc-4bf7-b453-3490767a3567 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:58.116604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1357/2671] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:58.120490 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664bdac-6ef3-416b-a9bf-6028adbe2097 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:58.132204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664bdac-6ef3-416b-a9bf-6028adbe2097 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:58.141710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236451b9-4b96-4fd9-b4c5-2ad0fa21f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:58.142901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236451b9-4b96-4fd9-b4c5-2ad0fa21f3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:58.143409 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236451b9-4b96-4fd9-b4c5-2ad0fa21f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:58.143984 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236451b9-4b96-4fd9-b4c5-2ad0fa21f3b0 admin admin] PATH_INFO: `/v3/projects/b255e2475bc640249c2150879b3e447f/users/05adc58033cf4382a3e68e1ea07b1224/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:58.163117 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236451b9-4b96-4fd9-b4c5-2ad0fa21f3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b255e2475bc640249c2150879b3e447f, user_id=05adc58033cf4382a3e68e1ea07b1224, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:58.166090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236451b9-4b96-4fd9-b4c5-2ad0fa21f3b0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:58.285938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1315/2672] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:58 2022] PUT /identity/v3/projects/b255e2475bc640249c2150879b3e447f/users/05adc58033cf4382a3e68e1ea07b1224/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:58.299129 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e47c22-cfcc-499e-8a66-78e063c90f38 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:58.299521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e47c22-cfcc-499e-8a66-78e063c90f38 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:58.299877 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e47c22-cfcc-499e-8a66-78e063c90f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:58.330016 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-d6e47c22-cfcc-499e-8a66-78e063c90f38 None None] MFA Rules not processed for user `05adc58033cf4382a3e68e1ea07b1224`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:58.331492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d6e47c22-cfcc-499e-8a66-78e063c90f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:58.407803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1358/2673] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:12:58.413682 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236451b9-4b96-4fd9-b4c5-2ad0fa21f3b0 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:58.487047 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236451b9-4b96-4fd9-b4c5-2ad0fa21f3b0 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:58.492211 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192e78e-af55-4062-9668-ecc6daea8650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:58.493101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192e78e-af55-4062-9668-ecc6daea8650 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:58.493573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192e78e-af55-4062-9668-ecc6daea8650 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:58.494184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192e78e-af55-4062-9668-ecc6daea8650 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:58.495569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192e78e-af55-4062-9668-ecc6daea8650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:58.497885 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192e78e-af55-4062-9668-ecc6daea8650 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:58.580373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1316/2674] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:12:58 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:58.584564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e47c22-cfcc-499e-8a66-78e063c90f38 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:58.600410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e47c22-cfcc-499e-8a66-78e063c90f38 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:58.628703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:58.663147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fba3c8-e10f-46a7-8a5b-c37c2eba415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:58.663821 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fba3c8-e10f-46a7-8a5b-c37c2eba415c admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:58.664103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fba3c8-e10f-46a7-8a5b-c37c2eba415c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:58.664383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fba3c8-e10f-46a7-8a5b-c37c2eba415c admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:58.665067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fba3c8-e10f-46a7-8a5b-c37c2eba415c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:58.667190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fba3c8-e10f-46a7-8a5b-c37c2eba415c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:58.803126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1359/2675] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:12:58 2022] POST /identity/v3/users => generated 300 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:12:58.804763 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192e78e-af55-4062-9668-ecc6daea8650 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:58.826823 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192e78e-af55-4062-9668-ecc6daea8650 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:58.836743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923be62b-5645-4d4d-958f-544d9d230d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:58.837437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be62b-5645-4d4d-958f-544d9d230d3a admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:58.837723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be62b-5645-4d4d-958f-544d9d230d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:58.838002 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923be62b-5645-4d4d-958f-544d9d230d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:58.838737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923be62b-5645-4d4d-958f-544d9d230d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:58.843031 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923be62b-5645-4d4d-958f-544d9d230d3a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:58.867849 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1317/2676] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:12:58.868891 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fba3c8-e10f-46a7-8a5b-c37c2eba415c admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:58.887082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fba3c8-e10f-46a7-8a5b-c37c2eba415c admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:58.905861 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa757e-4379-4d14-ad5d-ff75cd858217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:58.907216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa757e-4379-4d14-ad5d-ff75cd858217 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:58.909209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923be62b-5645-4d4d-958f-544d9d230d3a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:58.909350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa757e-4379-4d14-ad5d-ff75cd858217 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:58.909350 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa757e-4379-4d14-ad5d-ff75cd858217 admin admin] PATH_INFO: `/v3/projects/1313e2ce21294f318cbb649aaae98969/users/959f2c5e9e1144e4a59e8236af6444d2/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:58.909523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-923be62b-5645-4d4d-958f-544d9d230d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:58.926726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa757e-4379-4d14-ad5d-ff75cd858217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1313e2ce21294f318cbb649aaae98969, user_id=959f2c5e9e1144e4a59e8236af6444d2, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:58.929509 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa757e-4379-4d14-ad5d-ff75cd858217 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:58.975995 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923be62b-5645-4d4d-958f-544d9d230d3a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:58.979665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e96fd-a7ee-4ac2-8217-1c36c2c045c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:58.980315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e96fd-a7ee-4ac2-8217-1c36c2c045c4 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:58.980604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e96fd-a7ee-4ac2-8217-1c36c2c045c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:58.980909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e96fd-a7ee-4ac2-8217-1c36c2c045c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:58.982693 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-029e96fd-a7ee-4ac2-8217-1c36c2c045c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:59.055435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e96fd-a7ee-4ac2-8217-1c36c2c045c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:59.057652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e96fd-a7ee-4ac2-8217-1c36c2c045c4 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:59.069342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1318/2677] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:12:59.084070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1360/2678] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:58 2022] PUT /identity/v3/projects/1313e2ce21294f318cbb649aaae98969/users/959f2c5e9e1144e4a59e8236af6444d2/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:59.087581 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e96fd-a7ee-4ac2-8217-1c36c2c045c4 service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:59.105286 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e96fd-a7ee-4ac2-8217-1c36c2c045c4 service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:59.169808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1e91e-5f00-42b0-9d89-b75871a2cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:59.170612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e91e-5f00-42b0-9d89-b75871a2cab0 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:59.171771 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e91e-5f00-42b0-9d89-b75871a2cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:59.172200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1e91e-5f00-42b0-9d89-b75871a2cab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:59.173136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1e91e-5f00-42b0-9d89-b75871a2cab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:59.175016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1e91e-5f00-42b0-9d89-b75871a2cab0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:59.190877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1319/2679] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:12:59.192182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa757e-4379-4d14-ad5d-ff75cd858217 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:59.202801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa757e-4379-4d14-ad5d-ff75cd858217 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:59.208237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d440e63-50ea-4509-b59c-b69b9ea173f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:59.209147 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d440e63-50ea-4509-b59c-b69b9ea173f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:59.209828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d440e63-50ea-4509-b59c-b69b9ea173f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:59.210126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d440e63-50ea-4509-b59c-b69b9ea173f9 admin admin] PATH_INFO: `/v3/projects/1313e2ce21294f318cbb649aaae98969/users/959f2c5e9e1144e4a59e8236af6444d2/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:59.213951 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d440e63-50ea-4509-b59c-b69b9ea173f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1313e2ce21294f318cbb649aaae98969, user_id=959f2c5e9e1144e4a59e8236af6444d2, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:59.219576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d440e63-50ea-4509-b59c-b69b9ea173f9 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:59.232174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1361/2680] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:12:59 2022] PUT /identity/v3/projects/1313e2ce21294f318cbb649aaae98969/users/959f2c5e9e1144e4a59e8236af6444d2/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:12:59.243033 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a591a8-95c3-4d46-a91c-841f9e372e54 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:59.243346 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a591a8-95c3-4d46-a91c-841f9e372e54 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:59.243646 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a591a8-95c3-4d46-a91c-841f9e372e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:59.259390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=100 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:59.278549 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-e3a591a8-95c3-4d46-a91c-841f9e372e54 None None] MFA Rules not processed for user `959f2c5e9e1144e4a59e8236af6444d2`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:59.279822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e3a591a8-95c3-4d46-a91c-841f9e372e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:59.361718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1320/2681] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:12:59.373541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d440e63-50ea-4509-b59c-b69b9ea173f9 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:59.376055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9d440e63-50ea-4509-b59c-b69b9ea173f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:59.441315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d440e63-50ea-4509-b59c-b69b9ea173f9 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:59.445514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98f399-9a87-43de-a753-3614d376922c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:59.446397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98f399-9a87-43de-a753-3614d376922c service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:59.446679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98f399-9a87-43de-a753-3614d376922c service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:59.447053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98f399-9a87-43de-a753-3614d376922c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:59.465842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98f399-9a87-43de-a753-3614d376922c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:59.467411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98f399-9a87-43de-a753-3614d376922c service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:59.479389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1362/2682] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:12:59.555453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a591a8-95c3-4d46-a91c-841f9e372e54 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:59.668127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a591a8-95c3-4d46-a91c-841f9e372e54 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:12:59.679574 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:12:59.683273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:59.683727 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:59.684070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] PATH_INFO: `/v3/users/05adc58033cf4382a3e68e1ea07b1224` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:59.685709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05adc58033cf4382a3e68e1ea07b1224)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:12:59.689636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:12:59.803838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:59.857489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cb7a2-4c37-440a-8141-45a1b83b1c03 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:12:59.857777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cb7a2-4c37-440a-8141-45a1b83b1c03 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:12:59.858052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cb7a2-4c37-440a-8141-45a1b83b1c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:12:59.867048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:12:59.892342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05adc58033cf4382a3e68e1ea07b1224'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:59.893016 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05adc58033cf4382a3e68e1ea07b1224'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:59.894498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05adc58033cf4382a3e68e1ea07b1224'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:59.896796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-dc9cb7a2-4c37-440a-8141-45a1b83b1c03 None None] MFA Rules not processed for user `854568777d1849579f2f812c28842bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:12:59.898061 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-dc9cb7a2-4c37-440a-8141-45a1b83b1c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:12:59.904819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05adc58033cf4382a3e68e1ea07b1224'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:59.919141 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-5dce2dcb-f773-4c7c-b0b9-cbd91a402a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05adc58033cf4382a3e68e1ea07b1224'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:12:59.975611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1363/2683] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:12:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:12:59.993156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cb7a2-4c37-440a-8141-45a1b83b1c03 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:12:59.994660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-dc9cb7a2-4c37-440a-8141-45a1b83b1c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:00.018364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1321/2684] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:12:59 2022] DELETE /identity/v3/users/05adc58033cf4382a3e68e1ea07b1224 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:00.020313 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084f68-8098-4b5e-8681-ed67c57f9452 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:00.020616 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084f68-8098-4b5e-8681-ed67c57f9452 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:00.020922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084f68-8098-4b5e-8681-ed67c57f9452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:00.042509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-b1084f68-8098-4b5e-8681-ed67c57f9452 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:00.043814 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b1084f68-8098-4b5e-8681-ed67c57f9452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:00.089777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cb7a2-4c37-440a-8141-45a1b83b1c03 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:00.112152 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1322/2685] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:00.127079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084f68-8098-4b5e-8681-ed67c57f9452 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:00.128709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b1084f68-8098-4b5e-8681-ed67c57f9452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:00.165107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca247-84d9-439c-a634-49d3bc529ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:00.166746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca247-84d9-439c-a634-49d3bc529ee0 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:00.167160 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca247-84d9-439c-a634-49d3bc529ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:00.167549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ca247-84d9-439c-a634-49d3bc529ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:00.170680 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ae1ca247-84d9-439c-a634-49d3bc529ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:00.196327 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084f68-8098-4b5e-8681-ed67c57f9452 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:00.200317 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6479a3-25cc-4acd-b5ae-d722f7a15d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:00.201022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6479a3-25cc-4acd-b5ae-d722f7a15d7f service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:00.201398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6479a3-25cc-4acd-b5ae-d722f7a15d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:00.201579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6479a3-25cc-4acd-b5ae-d722f7a15d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:00.213329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6479a3-25cc-4acd-b5ae-d722f7a15d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:00.215284 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6479a3-25cc-4acd-b5ae-d722f7a15d7f service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:00.228193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1323/2686] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:00.239761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ca247-84d9-439c-a634-49d3bc529ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:00.241433 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1ca247-84d9-439c-a634-49d3bc529ee0 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:00.251050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1364/2687] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:12:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:00.731501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6479a3-25cc-4acd-b5ae-d722f7a15d7f service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:00.733847 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2f6479a3-25cc-4acd-b5ae-d722f7a15d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:00.751536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6479a3-25cc-4acd-b5ae-d722f7a15d7f service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:00.758294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:00.759289 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:00.760045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:00.760045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] PATH_INFO: `/v3/projects/b255e2475bc640249c2150879b3e447f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:00.761982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=b255e2475bc640249c2150879b3e447f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:00.765900 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:00.917947 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b255e2475bc640249c2150879b3e447f', 'request_id': 'req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:00.924515 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b255e2475bc640249c2150879b3e447f', 'request_id': 'req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:00.931858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b255e2475bc640249c2150879b3e447f', 'request_id': 'req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:01.025315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] The token cache is being invalidate because project b255e2475bc640249c2150879b3e447f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:01.025604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:01.026246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:01.027829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1324/2688] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:00 2022] DELETE /identity/v3/projects/b255e2475bc640249c2150879b3e447f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:01.032279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca247-84d9-439c-a634-49d3bc529ee0 service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:01.043489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ca247-84d9-439c-a634-49d3bc529ee0 service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:01.099390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:01.100423 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:01.100704 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:01.100976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] PATH_INFO: `/v3/users/959f2c5e9e1144e4a59e8236af6444d2` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:01.102176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=959f2c5e9e1144e4a59e8236af6444d2)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:01.104190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:01.396761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959f2c5e9e1144e4a59e8236af6444d2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:01.397541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959f2c5e9e1144e4a59e8236af6444d2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:01.398144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959f2c5e9e1144e4a59e8236af6444d2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:01.471826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959f2c5e9e1144e4a59e8236af6444d2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:01.479917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-05ab5266-5449-464b-83a3-13bd07552149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959f2c5e9e1144e4a59e8236af6444d2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:01.496949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1365/2689] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:13:01 2022] DELETE /identity/v3/users/959f2c5e9e1144e4a59e8236af6444d2 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:01.974683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:02.018035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:02.020075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:02.035756 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca61dd-2c6a-4b95-b48b-cc0fe1cac8de admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:02.050379 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:02.094677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:02.095556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:02.095835 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:02.096105 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] PATH_INFO: `/v3/projects/1313e2ce21294f318cbb649aaae98969` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:02.097426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1313e2ce21294f318cbb649aaae98969)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:02.099369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:02.255259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1313e2ce21294f318cbb649aaae98969', 'request_id': 'req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:02.260983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1313e2ce21294f318cbb649aaae98969', 'request_id': 'req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:02.267636 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1313e2ce21294f318cbb649aaae98969', 'request_id': 'req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:02.402707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] The token cache is being invalidate because project 1313e2ce21294f318cbb649aaae98969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:02.403048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:02.403733 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fb2ec70d-26b0-4fbb-a7ee-32908fd0f721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:02.405717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1325/2690] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:02 2022] DELETE /identity/v3/projects/1313e2ce21294f318cbb649aaae98969 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:02.411412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90a6ac-d683-43f0-9968-cd1803bf04c8 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:02.412698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90a6ac-d683-43f0-9968-cd1803bf04c8 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:02.413070 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90a6ac-d683-43f0-9968-cd1803bf04c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:02.437557 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ef90a6ac-d683-43f0-9968-cd1803bf04c8 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:02.439196 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ef90a6ac-d683-43f0-9968-cd1803bf04c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:02.522360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1366/2691] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:13:02.547042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc64e6f-8cf6-471c-aae8-1fb0346ab820 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:02.547277 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc64e6f-8cf6-471c-aae8-1fb0346ab820 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:02.547554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc64e6f-8cf6-471c-aae8-1fb0346ab820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:02.567774 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-edc64e6f-8cf6-471c-aae8-1fb0346ab820 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:02.568992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-edc64e6f-8cf6-471c-aae8-1fb0346ab820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:02.577227 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1326/2692] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:02.581459 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90a6ac-d683-43f0-9968-cd1803bf04c8 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:02.591928 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90a6ac-d683-43f0-9968-cd1803bf04c8 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:02.596774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06863feb-3abd-4091-93c3-1d257759146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:02.597475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06863feb-3abd-4091-93c3-1d257759146a admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:02.597753 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06863feb-3abd-4091-93c3-1d257759146a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:02.598137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06863feb-3abd-4091-93c3-1d257759146a admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:02.598882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06863feb-3abd-4091-93c3-1d257759146a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:13:02.600992 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06863feb-3abd-4091-93c3-1d257759146a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:02.601697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06863feb-3abd-4091-93c3-1d257759146a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:02.614651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1367/2693] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:13:02.619204 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc64e6f-8cf6-471c-aae8-1fb0346ab820 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:02.629109 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc64e6f-8cf6-471c-aae8-1fb0346ab820 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:02.633745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416978-63dc-4d23-acfa-45cd92a78314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:02.634393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416978-63dc-4d23-acfa-45cd92a78314 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:02.634674 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416978-63dc-4d23-acfa-45cd92a78314 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:02.634950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9416978-63dc-4d23-acfa-45cd92a78314 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:02.635677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9416978-63dc-4d23-acfa-45cd92a78314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:02.637576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9416978-63dc-4d23-acfa-45cd92a78314 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:02.813442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1327/2694] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:13:02 2022] POST /identity/v3/projects => generated 401 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:02.817522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06863feb-3abd-4091-93c3-1d257759146a admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:02.828294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06863feb-3abd-4091-93c3-1d257759146a admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:02.890662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0252c8-85ee-4f8f-8c6d-20bcafd02075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:02.891348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0252c8-85ee-4f8f-8c6d-20bcafd02075 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:02.891635 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0252c8-85ee-4f8f-8c6d-20bcafd02075 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:02.891916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0252c8-85ee-4f8f-8c6d-20bcafd02075 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:02.892606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0252c8-85ee-4f8f-8c6d-20bcafd02075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:02.894544 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0252c8-85ee-4f8f-8c6d-20bcafd02075 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:03.063835 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1368/2695] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:13:02 2022] POST /identity/v3/users => generated 301 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:03.065147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416978-63dc-4d23-acfa-45cd92a78314 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:03.075747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9416978-63dc-4d23-acfa-45cd92a78314 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:03.080432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a46c69-d68b-42c0-896a-b107e69c9f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:03.081099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46c69-d68b-42c0-896a-b107e69c9f73 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:03.081381 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46c69-d68b-42c0-896a-b107e69c9f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:03.081659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46c69-d68b-42c0-896a-b107e69c9f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:03.082385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a46c69-d68b-42c0-896a-b107e69c9f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:03.084051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a46c69-d68b-42c0-896a-b107e69c9f73 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:03.101669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1328/2696] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:13:03.105798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0252c8-85ee-4f8f-8c6d-20bcafd02075 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:03.125472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0252c8-85ee-4f8f-8c6d-20bcafd02075 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:03.134189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6df249-36ee-4d15-9954-e090f1a4faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:03.134189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6df249-36ee-4d15-9954-e090f1a4faba admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:03.134189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6df249-36ee-4d15-9954-e090f1a4faba admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:03.134189 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6df249-36ee-4d15-9954-e090f1a4faba admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:03.134589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6df249-36ee-4d15-9954-e090f1a4faba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:03.134589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6df249-36ee-4d15-9954-e090f1a4faba admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:03.147843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1369/2697] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:03.151972 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a46c69-d68b-42c0-896a-b107e69c9f73 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:03.163092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a46c69-d68b-42c0-896a-b107e69c9f73 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:03.167865 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd6a58-4a1c-4771-b800-07550d61879d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:03.168752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6a58-4a1c-4771-b800-07550d61879d admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:03.169030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6a58-4a1c-4771-b800-07550d61879d admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:03.169303 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd6a58-4a1c-4771-b800-07550d61879d admin admin] PATH_INFO: `/v3/projects/d6e78da28d224edda6c553a360be4cf7/users/6eb57fb713c24336be9e16e76443e475/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:03.184049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd6a58-4a1c-4771-b800-07550d61879d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e78da28d224edda6c553a360be4cf7, user_id=6eb57fb713c24336be9e16e76443e475, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:03.186992 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd6a58-4a1c-4771-b800-07550d61879d admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:03.272730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1329/2698] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:03 2022] PUT /identity/v3/projects/d6e78da28d224edda6c553a360be4cf7/users/6eb57fb713c24336be9e16e76443e475/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:03.284856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060012d0-6901-447a-a498-f32c9f84ee2b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:03.285149 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060012d0-6901-447a-a498-f32c9f84ee2b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:03.285456 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060012d0-6901-447a-a498-f32c9f84ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:03.316547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-060012d0-6901-447a-a498-f32c9f84ee2b None None] MFA Rules not processed for user `6eb57fb713c24336be9e16e76443e475`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:03.316547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-060012d0-6901-447a-a498-f32c9f84ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:03.382899 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1370/2699] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:03.387698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd6a58-4a1c-4771-b800-07550d61879d admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:03.459824 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd6a58-4a1c-4771-b800-07550d61879d admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:03.461786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff19f9-b5b2-4cf5-baea-10afe142c597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:03.461786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff19f9-b5b2-4cf5-baea-10afe142c597 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:03.461786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff19f9-b5b2-4cf5-baea-10afe142c597 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:03.461786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff19f9-b5b2-4cf5-baea-10afe142c597 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:03.462620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff19f9-b5b2-4cf5-baea-10afe142c597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:03.465911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff19f9-b5b2-4cf5-baea-10afe142c597 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:03.582487 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1330/2700] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:13:03 2022] POST /identity/v3/projects => generated 399 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:03.586700 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060012d0-6901-447a-a498-f32c9f84ee2b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:03.597780 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060012d0-6901-447a-a498-f32c9f84ee2b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:03.629453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:03.639049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8874d-c5d5-4e7e-9038-7eec2af1ac9d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:03.640650 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8874d-c5d5-4e7e-9038-7eec2af1ac9d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:03.641562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8874d-c5d5-4e7e-9038-7eec2af1ac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:03.662081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-e1b8874d-c5d5-4e7e-9038-7eec2af1ac9d None None] MFA Rules not processed for user `9bf4783f2e7b404bbc71a99f753f0303`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:03.664298 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e1b8874d-c5d5-4e7e-9038-7eec2af1ac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:03.681231 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa88b6-5c50-462f-8a96-09ed02731b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:03.682196 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa88b6-5c50-462f-8a96-09ed02731b3a admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:03.682719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa88b6-5c50-462f-8a96-09ed02731b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:03.683172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa88b6-5c50-462f-8a96-09ed02731b3a admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:03.683881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa88b6-5c50-462f-8a96-09ed02731b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:03.685923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa88b6-5c50-462f-8a96-09ed02731b3a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:03.732601 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1331/2701] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:13:03.841717 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1371/2702] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:13:03 2022] POST /identity/v3/users => generated 306 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:13:03.842337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8874d-c5d5-4e7e-9038-7eec2af1ac9d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:03.862400 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8874d-c5d5-4e7e-9038-7eec2af1ac9d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:03.867350 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545224-b3e2-4cd6-8955-a5ef1fa8d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:03.871244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545224-b3e2-4cd6-8955-a5ef1fa8d3ed admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:03.871244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545224-b3e2-4cd6-8955-a5ef1fa8d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:03.871244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d545224-b3e2-4cd6-8955-a5ef1fa8d3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:03.871244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545224-b3e2-4cd6-8955-a5ef1fa8d3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:03.871244 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d545224-b3e2-4cd6-8955-a5ef1fa8d3ed admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:03.884138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1332/2703] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:03.888371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa88b6-5c50-462f-8a96-09ed02731b3a admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:03.901191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa88b6-5c50-462f-8a96-09ed02731b3a admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:03.907492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef45a7f-308d-40a3-8247-65a229262da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:03.908326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef45a7f-308d-40a3-8247-65a229262da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:03.908737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef45a7f-308d-40a3-8247-65a229262da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:03.908973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef45a7f-308d-40a3-8247-65a229262da2 admin admin] PATH_INFO: `/v3/projects/f20d078510b4419cbbbdce86f814ab03/users/f811f08e19ea4887aca78ce42bf0f770/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:03.926385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef45a7f-308d-40a3-8247-65a229262da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20d078510b4419cbbbdce86f814ab03, user_id=f811f08e19ea4887aca78ce42bf0f770, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:03.929256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef45a7f-308d-40a3-8247-65a229262da2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:04.115028 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1372/2704] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:03 2022] PUT /identity/v3/projects/f20d078510b4419cbbbdce86f814ab03/users/f811f08e19ea4887aca78ce42bf0f770/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:04.119230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545224-b3e2-4cd6-8955-a5ef1fa8d3ed admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:04.130584 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d545224-b3e2-4cd6-8955-a5ef1fa8d3ed admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:04.258670 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5233e78b-eec8-4a44-8340-0c1267b12382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:04.259523 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e78b-eec8-4a44-8340-0c1267b12382 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:04.259869 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e78b-eec8-4a44-8340-0c1267b12382 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:04.266768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233e78b-eec8-4a44-8340-0c1267b12382 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:04.266768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233e78b-eec8-4a44-8340-0c1267b12382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:04.266768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5233e78b-eec8-4a44-8340-0c1267b12382 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:04.274239 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1333/2705] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:13:04.279469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef45a7f-308d-40a3-8247-65a229262da2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:04.292596 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef45a7f-308d-40a3-8247-65a229262da2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:04.302671 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f829c14-20ff-4e4e-8deb-f68d569d04a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:04.303741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f829c14-20ff-4e4e-8deb-f68d569d04a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:04.304030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f829c14-20ff-4e4e-8deb-f68d569d04a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:04.304302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f829c14-20ff-4e4e-8deb-f68d569d04a4 admin admin] PATH_INFO: `/v3/projects/f20d078510b4419cbbbdce86f814ab03/users/f811f08e19ea4887aca78ce42bf0f770/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:04.306400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f829c14-20ff-4e4e-8deb-f68d569d04a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20d078510b4419cbbbdce86f814ab03, user_id=f811f08e19ea4887aca78ce42bf0f770, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:04.309505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f829c14-20ff-4e4e-8deb-f68d569d04a4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:04.330803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1373/2706] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:04 2022] PUT /identity/v3/projects/f20d078510b4419cbbbdce86f814ab03/users/f811f08e19ea4887aca78ce42bf0f770/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:04.342429 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8198430-d39f-4396-9096-56ed5a3c8095 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:04.343622 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8198430-d39f-4396-9096-56ed5a3c8095 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:04.346084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8198430-d39f-4396-9096-56ed5a3c8095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:04.361816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:04.390923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-d8198430-d39f-4396-9096-56ed5a3c8095 None None] MFA Rules not processed for user `f811f08e19ea4887aca78ce42bf0f770`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:04.392247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d8198430-d39f-4396-9096-56ed5a3c8095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:04.475953 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1334/2707] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:04.490823 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f829c14-20ff-4e4e-8deb-f68d569d04a4 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:04.491601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7f829c14-20ff-4e4e-8deb-f68d569d04a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:04.568703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f829c14-20ff-4e4e-8deb-f68d569d04a4 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:04.573311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6988a7-459e-4999-bb16-f49da9c6fd09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:04.573995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6988a7-459e-4999-bb16-f49da9c6fd09 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:04.574260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6988a7-459e-4999-bb16-f49da9c6fd09 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:04.574562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6988a7-459e-4999-bb16-f49da9c6fd09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:04.587910 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6988a7-459e-4999-bb16-f49da9c6fd09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:04.591301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6988a7-459e-4999-bb16-f49da9c6fd09 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:04.604486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1374/2708] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:04 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:04.807098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:04.919833 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8198430-d39f-4396-9096-56ed5a3c8095 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:04.921435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d8198430-d39f-4396-9096-56ed5a3c8095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:04.935322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8198430-d39f-4396-9096-56ed5a3c8095 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:04.939175 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee51bf-ad0c-4078-bd75-8199be522396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:04.939840 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee51bf-ad0c-4078-bd75-8199be522396 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:04.940141 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee51bf-ad0c-4078-bd75-8199be522396 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:04.940385 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee51bf-ad0c-4078-bd75-8199be522396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:05.000577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee51bf-ad0c-4078-bd75-8199be522396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:05.002049 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee51bf-ad0c-4078-bd75-8199be522396 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:05.017929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1335/2709] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:05.383106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:06.325569 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:06.534434 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:06.820562 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:07.523453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:08.235182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:11.333515 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6988a7-459e-4999-bb16-f49da9c6fd09 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:11.401804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6988a7-459e-4999-bb16-f49da9c6fd09 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:11.407132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:11.408029 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:11.408319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:11.410588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] PATH_INFO: `/v3/users/6eb57fb713c24336be9e16e76443e475` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:11.410588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb57fb713c24336be9e16e76443e475)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:11.411783 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:11.625580 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb57fb713c24336be9e16e76443e475'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:11.626159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb57fb713c24336be9e16e76443e475'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:11.626756 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb57fb713c24336be9e16e76443e475'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:11.759774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb57fb713c24336be9e16e76443e475'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:11.767987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb57fb713c24336be9e16e76443e475'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:11.786296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1375/2710] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:13:11 2022] DELETE /identity/v3/users/6eb57fb713c24336be9e16e76443e475 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:11.790804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d8c91-e3a6-42dc-8764-9a227c893a86 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:11.791334 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d8c91-e3a6-42dc-8764-9a227c893a86 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:11.791451 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d8c91-e3a6-42dc-8764-9a227c893a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:11.809378 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-0b6d8c91-e3a6-42dc-8764-9a227c893a86 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:11.810603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0b6d8c91-e3a6-42dc-8764-9a227c893a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:11.872215 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1336/2711] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:11.887667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:11.889087 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:11.934911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:11.949258 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26863b-2285-46ed-a1f0-b21105e11ac6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:11.953916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c661-eb2a-4dc7-b20b-fb8b65041f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:11.954140 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c661-eb2a-4dc7-b20b-fb8b65041f84 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:11.954427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c661-eb2a-4dc7-b20b-fb8b65041f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:11.954705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3c661-eb2a-4dc7-b20b-fb8b65041f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:11.963842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c661-eb2a-4dc7-b20b-fb8b65041f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:11.965599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3c661-eb2a-4dc7-b20b-fb8b65041f84 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:11.975936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1376/2712] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:12.404966 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d8c91-e3a6-42dc-8764-9a227c893a86 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:12.412000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-0b6d8c91-e3a6-42dc-8764-9a227c893a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:12.418503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d8c91-e3a6-42dc-8764-9a227c893a86 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:12.423967 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:12.424830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:12.425106 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:12.425382 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] PATH_INFO: `/v3/projects/d6e78da28d224edda6c553a360be4cf7` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:12.426561 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e78da28d224edda6c553a360be4cf7)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:12.428570 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:12.580266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:12.583618 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e78da28d224edda6c553a360be4cf7', 'request_id': 'req-9ce026ef-6f32-457b-8b4e-21de679c4b5e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:12.588920 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e78da28d224edda6c553a360be4cf7', 'request_id': 'req-9ce026ef-6f32-457b-8b4e-21de679c4b5e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:12.596220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e78da28d224edda6c553a360be4cf7', 'request_id': 'req-9ce026ef-6f32-457b-8b4e-21de679c4b5e'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:12.668604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] The token cache is being invalidate because project d6e78da28d224edda6c553a360be4cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:12.669190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:12.669915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:12.672454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1337/2713] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:12 2022] DELETE /identity/v3/projects/d6e78da28d224edda6c553a360be4cf7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:12.677575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c661-eb2a-4dc7-b20b-fb8b65041f84 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:12.687144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3c661-eb2a-4dc7-b20b-fb8b65041f84 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:12.745510 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:12.746376 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:12.746658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:12.746935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] PATH_INFO: `/v3/users/f811f08e19ea4887aca78ce42bf0f770` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:12.748138 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f811f08e19ea4887aca78ce42bf0f770)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:12.750078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:12.956736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f811f08e19ea4887aca78ce42bf0f770'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:12.957345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f811f08e19ea4887aca78ce42bf0f770'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:12.957955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f811f08e19ea4887aca78ce42bf0f770'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:13.045102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f811f08e19ea4887aca78ce42bf0f770'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:13.052960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b04f0d97-063e-4ee8-9065-ff32717d12b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f811f08e19ea4887aca78ce42bf0f770'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:13.070534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1377/2714] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:13:12 2022] DELETE /identity/v3/users/f811f08e19ea4887aca78ce42bf0f770 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:13.587891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:13.589462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:13.604091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce026ef-6f32-457b-8b4e-21de679c4b5e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:13.667349 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:13.668282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:13.668579 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:13.668870 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] PATH_INFO: `/v3/projects/f20d078510b4419cbbbdce86f814ab03` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:13.670257 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20d078510b4419cbbbdce86f814ab03)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:13.673034 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:13.853226 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20d078510b4419cbbbdce86f814ab03', 'request_id': 'req-4065c370-50b6-4352-aee4-47fe7cfaf95f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:13.859718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20d078510b4419cbbbdce86f814ab03', 'request_id': 'req-4065c370-50b6-4352-aee4-47fe7cfaf95f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:13.868931 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20d078510b4419cbbbdce86f814ab03', 'request_id': 'req-4065c370-50b6-4352-aee4-47fe7cfaf95f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:13.960144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] The token cache is being invalidate because project f20d078510b4419cbbbdce86f814ab03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:13.960418 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:13.961057 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4065c370-50b6-4352-aee4-47fe7cfaf95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:13.962660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1338/2715] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:13 2022] DELETE /identity/v3/projects/f20d078510b4419cbbbdce86f814ab03 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:13.968794 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395aeb9-3953-4d38-98c1-0318c2bf421c None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:13.969287 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395aeb9-3953-4d38-98c1-0318c2bf421c None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:13.969387 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395aeb9-3953-4d38-98c1-0318c2bf421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:13.988495 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-1395aeb9-3953-4d38-98c1-0318c2bf421c None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:13.989708 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1395aeb9-3953-4d38-98c1-0318c2bf421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:14.054132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1378/2716] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:14.062487 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dcac0-6d39-4cea-b01d-ef3332e4fbfa None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:14.062867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dcac0-6d39-4cea-b01d-ef3332e4fbfa None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:14.063173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dcac0-6d39-4cea-b01d-ef3332e4fbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:14.083361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a29dcac0-6d39-4cea-b01d-ef3332e4fbfa None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:14.085022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a29dcac0-6d39-4cea-b01d-ef3332e4fbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:14.093772 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1339/2717] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:14.098153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395aeb9-3953-4d38-98c1-0318c2bf421c None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:14.103037 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:14.108344 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395aeb9-3953-4d38-98c1-0318c2bf421c None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:14.113167 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3f7b-cd21-4603-bfc8-21aa01df4f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:14.113832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3f7b-cd21-4603-bfc8-21aa01df4f5c admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:14.114221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3f7b-cd21-4603-bfc8-21aa01df4f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:14.114497 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc3f7b-cd21-4603-bfc8-21aa01df4f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:14.115478 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc3f7b-cd21-4603-bfc8-21aa01df4f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:13:14.115788 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc3f7b-cd21-4603-bfc8-21aa01df4f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:14.117694 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc3f7b-cd21-4603-bfc8-21aa01df4f5c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:14.130789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1379/2718] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:13:14.135237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dcac0-6d39-4cea-b01d-ef3332e4fbfa None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:14.145721 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dcac0-6d39-4cea-b01d-ef3332e4fbfa None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:14.150421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bb80e-ad35-44ac-847c-47fad663f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:14.151202 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bb80e-ad35-44ac-847c-47fad663f593 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:14.151485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bb80e-ad35-44ac-847c-47fad663f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:14.151757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bb80e-ad35-44ac-847c-47fad663f593 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:14.152482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bb80e-ad35-44ac-847c-47fad663f593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:14.154370 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bb80e-ad35-44ac-847c-47fad663f593 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:14.267461 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1340/2719] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:13:14 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:14.271733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3f7b-cd21-4603-bfc8-21aa01df4f5c admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:14.281977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc3f7b-cd21-4603-bfc8-21aa01df4f5c admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:14.346693 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b893149-faff-46a7-8086-aacc26fe5744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:14.347473 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b893149-faff-46a7-8086-aacc26fe5744 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:14.347759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b893149-faff-46a7-8086-aacc26fe5744 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:14.348031 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b893149-faff-46a7-8086-aacc26fe5744 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:14.348729 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b893149-faff-46a7-8086-aacc26fe5744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:14.351838 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b893149-faff-46a7-8086-aacc26fe5744 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:14.486958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1380/2720] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:13:14 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:14.491242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bb80e-ad35-44ac-847c-47fad663f593 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:14.502376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bb80e-ad35-44ac-847c-47fad663f593 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:14.506925 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccfc23-8d27-4df1-80a4-b770648d79b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:14.507608 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccfc23-8d27-4df1-80a4-b770648d79b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:14.507894 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccfc23-8d27-4df1-80a4-b770648d79b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:14.508172 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccfc23-8d27-4df1-80a4-b770648d79b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:14.509074 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccfc23-8d27-4df1-80a4-b770648d79b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:14.510778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ccfc23-8d27-4df1-80a4-b770648d79b2 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:14.522903 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1341/2721] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:14.527174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b893149-faff-46a7-8086-aacc26fe5744 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:14.538323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b893149-faff-46a7-8086-aacc26fe5744 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:14.543317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a5f62-a191-4008-a238-e12a0afb413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:14.544082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5f62-a191-4008-a238-e12a0afb413f admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:14.544665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5f62-a191-4008-a238-e12a0afb413f admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:14.545114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a5f62-a191-4008-a238-e12a0afb413f admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:14.546373 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a5f62-a191-4008-a238-e12a0afb413f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:14.548561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a5f62-a191-4008-a238-e12a0afb413f admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:14.559817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1381/2722] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:13:14.565685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccfc23-8d27-4df1-80a4-b770648d79b2 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:14.576928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccfc23-8d27-4df1-80a4-b770648d79b2 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:14.582000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d378da-a4be-40a8-a5b0-1d2780289394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:14.584240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d378da-a4be-40a8-a5b0-1d2780289394 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:14.584554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d378da-a4be-40a8-a5b0-1d2780289394 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:14.584826 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d378da-a4be-40a8-a5b0-1d2780289394 admin admin] PATH_INFO: `/v3/projects/56195a9742c747049a292d5e1d316fec/users/f373122e635c48638815e42c8be7d989/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:14.602759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d378da-a4be-40a8-a5b0-1d2780289394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56195a9742c747049a292d5e1d316fec, user_id=f373122e635c48638815e42c8be7d989, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:14.605455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d378da-a4be-40a8-a5b0-1d2780289394 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:14.708928 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:14.714709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1342/2723] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:14 2022] PUT /identity/v3/projects/56195a9742c747049a292d5e1d316fec/users/f373122e635c48638815e42c8be7d989/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:14.726436 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04656-66c6-4009-9d60-52d2b9bdffa9 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:14.726731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04656-66c6-4009-9d60-52d2b9bdffa9 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:14.727033 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04656-66c6-4009-9d60-52d2b9bdffa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:14.757819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ebd04656-66c6-4009-9d60-52d2b9bdffa9 None None] MFA Rules not processed for user `f373122e635c48638815e42c8be7d989`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:14.759162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ebd04656-66c6-4009-9d60-52d2b9bdffa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:14.826593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1382/2724] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:14.831309 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d378da-a4be-40a8-a5b0-1d2780289394 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:14.892809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d378da-a4be-40a8-a5b0-1d2780289394 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:14.897364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e36cc-3eb5-4972-848a-fe01113de606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:14.898020 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e36cc-3eb5-4972-848a-fe01113de606 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:14.898300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e36cc-3eb5-4972-848a-fe01113de606 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:14.898576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e36cc-3eb5-4972-848a-fe01113de606 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:14.899288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e36cc-3eb5-4972-848a-fe01113de606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:14.901222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e36cc-3eb5-4972-848a-fe01113de606 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:15.012104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1343/2725] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:13:14 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:15.016448 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04656-66c6-4009-9d60-52d2b9bdffa9 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:15.027524 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04656-66c6-4009-9d60-52d2b9bdffa9 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:15.079846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:15.085108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c1f45-bb10-4d20-80ea-2fecce0c7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:15.085805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c1f45-bb10-4d20-80ea-2fecce0c7c52 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:15.086085 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c1f45-bb10-4d20-80ea-2fecce0c7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:15.086359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c1f45-bb10-4d20-80ea-2fecce0c7c52 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:15.087083 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c1f45-bb10-4d20-80ea-2fecce0c7c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:15.089012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c1f45-bb10-4d20-80ea-2fecce0c7c52 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:15.165590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1383/2726] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:13:15 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:15.169509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e36cc-3eb5-4972-848a-fe01113de606 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:15.180672 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e36cc-3eb5-4972-848a-fe01113de606 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:15.185592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838652a7-938b-4be0-9c7c-8906b58c2d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:15.186262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838652a7-938b-4be0-9c7c-8906b58c2d39 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:15.186591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838652a7-938b-4be0-9c7c-8906b58c2d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:15.186866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838652a7-938b-4be0-9c7c-8906b58c2d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:15.187614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838652a7-938b-4be0-9c7c-8906b58c2d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:15.189290 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838652a7-938b-4be0-9c7c-8906b58c2d39 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:15.201580 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1344/2727] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:15.206584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c1f45-bb10-4d20-80ea-2fecce0c7c52 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:15.216921 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c1f45-bb10-4d20-80ea-2fecce0c7c52 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:15.222395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a0530-ffa7-48be-a796-5009e235a305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:15.223423 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a0530-ffa7-48be-a796-5009e235a305 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:15.223703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a0530-ffa7-48be-a796-5009e235a305 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:15.223977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a0530-ffa7-48be-a796-5009e235a305 admin admin] PATH_INFO: `/v3/projects/35f0706eb8844194b6a50207326f6185/users/208b2010ecfe48658334c226f5441dc9/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:15.239507 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a0530-ffa7-48be-a796-5009e235a305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f0706eb8844194b6a50207326f6185, user_id=208b2010ecfe48658334c226f5441dc9, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:15.242572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a0530-ffa7-48be-a796-5009e235a305 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:15.354565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1384/2728] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:15 2022] PUT /identity/v3/projects/35f0706eb8844194b6a50207326f6185/users/208b2010ecfe48658334c226f5441dc9/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:15.358589 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838652a7-938b-4be0-9c7c-8906b58c2d39 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:15.368937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838652a7-938b-4be0-9c7c-8906b58c2d39 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:15.434663 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e696b-b5cf-4800-a369-19bdd28e85df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:15.435376 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e696b-b5cf-4800-a369-19bdd28e85df admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:15.435656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e696b-b5cf-4800-a369-19bdd28e85df admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:15.435930 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e696b-b5cf-4800-a369-19bdd28e85df admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:15.436687 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e696b-b5cf-4800-a369-19bdd28e85df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:15.438428 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e696b-b5cf-4800-a369-19bdd28e85df admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:15.448799 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1345/2729] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:15.454894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a0530-ffa7-48be-a796-5009e235a305 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:15.465779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a0530-ffa7-48be-a796-5009e235a305 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:15.471401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec4ea8-a7fc-4e46-8f78-14f8cbaae733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:15.472282 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec4ea8-a7fc-4e46-8f78-14f8cbaae733 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:15.472563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec4ea8-a7fc-4e46-8f78-14f8cbaae733 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:15.472840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec4ea8-a7fc-4e46-8f78-14f8cbaae733 admin admin] PATH_INFO: `/v3/projects/35f0706eb8844194b6a50207326f6185/users/208b2010ecfe48658334c226f5441dc9/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:15.474817 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec4ea8-a7fc-4e46-8f78-14f8cbaae733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f0706eb8844194b6a50207326f6185, user_id=208b2010ecfe48658334c226f5441dc9, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:15.478990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec4ea8-a7fc-4e46-8f78-14f8cbaae733 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:15.488770 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1385/2730] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:15 2022] PUT /identity/v3/projects/35f0706eb8844194b6a50207326f6185/users/208b2010ecfe48658334c226f5441dc9/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:15.498665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81db2ae-15f2-4720-93bb-7549cf27d439 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:15.499273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81db2ae-15f2-4720-93bb-7549cf27d439 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:15.499833 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81db2ae-15f2-4720-93bb-7549cf27d439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:15.526063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f81db2ae-15f2-4720-93bb-7549cf27d439 None None] MFA Rules not processed for user `208b2010ecfe48658334c226f5441dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:15.527422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f81db2ae-15f2-4720-93bb-7549cf27d439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:15.587069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:15.598118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1346/2731] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:15.609465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec4ea8-a7fc-4e46-8f78-14f8cbaae733 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:15.611343 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-e8ec4ea8-a7fc-4e46-8f78-14f8cbaae733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:15.697659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec4ea8-a7fc-4e46-8f78-14f8cbaae733 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:15.701363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a96e6-9c57-41fd-ab33-90ca7facf39f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:15.702679 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a96e6-9c57-41fd-ab33-90ca7facf39f service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:15.703206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a96e6-9c57-41fd-ab33-90ca7facf39f service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:15.703494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a96e6-9c57-41fd-ab33-90ca7facf39f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:15.712842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a96e6-9c57-41fd-ab33-90ca7facf39f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:15.714312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a96e6-9c57-41fd-ab33-90ca7facf39f service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:15.724674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1386/2732] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:15.822838 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81db2ae-15f2-4720-93bb-7549cf27d439 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:15.833560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81db2ae-15f2-4720-93bb-7549cf27d439 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:15.837374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b22d24-9a92-4ca8-8d84-83c105f8ad9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:15.838145 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b22d24-9a92-4ca8-8d84-83c105f8ad9c service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:15.838459 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b22d24-9a92-4ca8-8d84-83c105f8ad9c service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:15.838739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b22d24-9a92-4ca8-8d84-83c105f8ad9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:15.899700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b22d24-9a92-4ca8-8d84-83c105f8ad9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:15.901184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b22d24-9a92-4ca8-8d84-83c105f8ad9c service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:15.910161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1347/2733] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:19.198254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a96e6-9c57-41fd-ab33-90ca7facf39f service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:19.263734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a96e6-9c57-41fd-ab33-90ca7facf39f service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:19.268812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:19.269672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:19.270117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:19.270390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] PATH_INFO: `/v3/users/f373122e635c48638815e42c8be7d989` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:19.271586 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f373122e635c48638815e42c8be7d989)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:19.273488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:19.466536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:19.478284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f373122e635c48638815e42c8be7d989'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:19.478977 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f373122e635c48638815e42c8be7d989'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:19.479615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f373122e635c48638815e42c8be7d989'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:19.599607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f373122e635c48638815e42c8be7d989'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:19.610132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f373122e635c48638815e42c8be7d989'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:19.631734 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1387/2734] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:13:19 2022] DELETE /identity/v3/users/f373122e635c48638815e42c8be7d989 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:19.635982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9e32d-5958-4209-8d2a-53cdd080222d None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:19.636454 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9e32d-5958-4209-8d2a-53cdd080222d None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:19.643705 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9e32d-5958-4209-8d2a-53cdd080222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:19.656019 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-1ee9e32d-5958-4209-8d2a-53cdd080222d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:19.657238 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1ee9e32d-5958-4209-8d2a-53cdd080222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:19.722476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1348/2735] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:13:19.732127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:19.734216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:19.792313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cdc18a-3c0a-4116-8474-1dda5773a057 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:19.796877 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0258-5614-4c07-bd03-39a49d87618c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:19.797634 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0258-5614-4c07-bd03-39a49d87618c service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:19.797894 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0258-5614-4c07-bd03-39a49d87618c service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:19.798171 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb0258-5614-4c07-bd03-39a49d87618c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:19.807938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb0258-5614-4c07-bd03-39a49d87618c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:19.809424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb0258-5614-4c07-bd03-39a49d87618c service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:19.820606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1388/2736] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:13:20.306479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9e32d-5958-4209-8d2a-53cdd080222d None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:20.306479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1ee9e32d-5958-4209-8d2a-53cdd080222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:20.307987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0258-5614-4c07-bd03-39a49d87618c service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:20.313922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9e32d-5958-4209-8d2a-53cdd080222d None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:20.314033 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3acb0258-5614-4c07-bd03-39a49d87618c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:20.318602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:20.319535 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:20.319820 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:20.320096 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] PATH_INFO: `/v3/projects/56195a9742c747049a292d5e1d316fec` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:20.321858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=56195a9742c747049a292d5e1d316fec)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:20.323808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:20.328523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb0258-5614-4c07-bd03-39a49d87618c service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:20.334620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:20.343446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:20.343446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:20.343446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] PATH_INFO: `/v3/users/bf8da46ffef046d0a54fbd51ab2aa9c1` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:20.343446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8da46ffef046d0a54fbd51ab2aa9c1)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:20.343446 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:20.544669 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8da46ffef046d0a54fbd51ab2aa9c1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.544888 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56195a9742c747049a292d5e1d316fec', 'request_id': 'req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.545236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8da46ffef046d0a54fbd51ab2aa9c1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.545960 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8da46ffef046d0a54fbd51ab2aa9c1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.550759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56195a9742c747049a292d5e1d316fec', 'request_id': 'req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.557192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56195a9742c747049a292d5e1d316fec', 'request_id': 'req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.614422 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8da46ffef046d0a54fbd51ab2aa9c1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.621852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8da46ffef046d0a54fbd51ab2aa9c1'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.643759 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1389/2737] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:13:20 2022] DELETE /identity/v3/users/bf8da46ffef046d0a54fbd51ab2aa9c1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:20.677274 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] The token cache is being invalidate because project 56195a9742c747049a292d5e1d316fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:20.677707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.678261 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.680304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1349/2738] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:20 2022] DELETE /identity/v3/projects/56195a9742c747049a292d5e1d316fec => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:20.684488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:20.686492 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:20.730983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:20.768062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc55c5-ab68-4a39-ac17-914ac89f3d57 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:20.773397 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:20.774274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:20.774560 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:20.774837 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] PATH_INFO: `/v3/users/208b2010ecfe48658334c226f5441dc9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:20.776081 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208b2010ecfe48658334c226f5441dc9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:20.778339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:20.919437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:20.919437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:20.935748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:20.952919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208b2010ecfe48658334c226f5441dc9'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.953789 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208b2010ecfe48658334c226f5441dc9'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.954423 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208b2010ecfe48658334c226f5441dc9'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:20.984699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dce3f-d2b6-4d30-9d2b-e8c90acfaa0c admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:20.989295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:20.990162 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:20.990442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:20.990717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] PATH_INFO: `/v3/projects/2ead526b3fb9470f8edf3c938464533f` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:20.991951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ead526b3fb9470f8edf3c938464533f)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:20.993853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:21.056498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208b2010ecfe48658334c226f5441dc9'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.064577 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208b2010ecfe48658334c226f5441dc9'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.082901 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1390/2739] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:13:20 2022] DELETE /identity/v3/users/208b2010ecfe48658334c226f5441dc9 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:21.103545 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ead526b3fb9470f8edf3c938464533f', 'request_id': 'req-1e93bcce-3b8e-43ca-991c-cda98f038d3f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.111633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ead526b3fb9470f8edf3c938464533f', 'request_id': 'req-1e93bcce-3b8e-43ca-991c-cda98f038d3f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.118142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ead526b3fb9470f8edf3c938464533f', 'request_id': 'req-1e93bcce-3b8e-43ca-991c-cda98f038d3f'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.208831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] The token cache is being invalidate because project 2ead526b3fb9470f8edf3c938464533f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:21.209127 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.209751 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.211365 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1350/2740] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:20 2022] DELETE /identity/v3/projects/2ead526b3fb9470f8edf3c938464533f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:21.215726 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:21.217168 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:21.289666 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1e513-c1ac-4f71-8826-8a7a83b78a93 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:21.346986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:21.355921 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:21.356805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:21.357067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:21.357339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] PATH_INFO: `/v3/users/b3da33f4b05542629ee61b863d313e44` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:21.359185 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3da33f4b05542629ee61b863d313e44)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:21.361152 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:21.564314 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:21.565834 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:21.584609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93bcce-3b8e-43ca-991c-cda98f038d3f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:21.589421 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:21.590223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:21.590781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:21.591091 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] PATH_INFO: `/v3/projects/35f0706eb8844194b6a50207326f6185` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:21.594603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f0706eb8844194b6a50207326f6185)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:21.595034 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:21.610592 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3da33f4b05542629ee61b863d313e44'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.612536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3da33f4b05542629ee61b863d313e44'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.613145 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3da33f4b05542629ee61b863d313e44'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.700190 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3da33f4b05542629ee61b863d313e44'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.708684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-7c8f9bcd-eede-4db7-bb0d-e79bcc7d7d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3da33f4b05542629ee61b863d313e44'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.729368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1391/2741] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:13:21 2022] DELETE /identity/v3/users/b3da33f4b05542629ee61b863d313e44 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:21.756563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f0706eb8844194b6a50207326f6185', 'request_id': 'req-2177b6f4-2ffb-47d2-b910-e094a3b16494'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.763121 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f0706eb8844194b6a50207326f6185', 'request_id': 'req-2177b6f4-2ffb-47d2-b910-e094a3b16494'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.771056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f0706eb8844194b6a50207326f6185', 'request_id': 'req-2177b6f4-2ffb-47d2-b910-e094a3b16494'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.862521 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] The token cache is being invalidate because project 35f0706eb8844194b6a50207326f6185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:21.862813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.863470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-2177b6f4-2ffb-47d2-b910-e094a3b16494 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:21.865026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1351/2742] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:21 2022] DELETE /identity/v3/projects/35f0706eb8844194b6a50207326f6185 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:21.870289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b69997-8cba-43bb-b43c-98d0b0523ada None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:21.870578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b69997-8cba-43bb-b43c-98d0b0523ada None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:21.870855 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b69997-8cba-43bb-b43c-98d0b0523ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:21.891396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-17b69997-8cba-43bb-b43c-98d0b0523ada None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:21.892617 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-17b69997-8cba-43bb-b43c-98d0b0523ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:21.953609 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1392/2743] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:13:21.961562 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131209-0a11-4546-b125-11487a20853a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:21.961864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131209-0a11-4546-b125-11487a20853a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:21.962153 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131209-0a11-4546-b125-11487a20853a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:21.982097 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-df131209-0a11-4546-b125-11487a20853a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:21.982657 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b69997-8cba-43bb-b43c-98d0b0523ada None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:21.983548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-df131209-0a11-4546-b125-11487a20853a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:21.984040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-17b69997-8cba-43bb-b43c-98d0b0523ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:21.995852 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b69997-8cba-43bb-b43c-98d0b0523ada None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:21.998364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1352/2744] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:22.001008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.002268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.002399 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df131209-0a11-4546-b125-11487a20853a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.002552 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.002828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] PATH_INFO: `/v3/projects/ce19b607b7a04b8baf22a01cd809d233` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.004276 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce19b607b7a04b8baf22a01cd809d233)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.006117 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.012692 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df131209-0a11-4546-b125-11487a20853a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.018329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040893a-471f-42e1-b643-48403348f7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.019026 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040893a-471f-42e1-b643-48403348f7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.019318 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040893a-471f-42e1-b643-48403348f7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.019607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040893a-471f-42e1-b643-48403348f7d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.020338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040893a-471f-42e1-b643-48403348f7d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:13:22.020653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040893a-471f-42e1-b643-48403348f7d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.022262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040893a-471f-42e1-b643-48403348f7d7 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.035367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1353/2745] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:13:22.039665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040893a-471f-42e1-b643-48403348f7d7 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.049899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040893a-471f-42e1-b643-48403348f7d7 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.054721 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a2f6a-b014-4c9b-a361-e6b1390b00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.055374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a2f6a-b014-4c9b-a361-e6b1390b00b0 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.055660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a2f6a-b014-4c9b-a361-e6b1390b00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.055936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a2f6a-b014-4c9b-a361-e6b1390b00b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.056614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a2f6a-b014-4c9b-a361-e6b1390b00b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.058497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a2f6a-b014-4c9b-a361-e6b1390b00b0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.062588 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:22.119601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce19b607b7a04b8baf22a01cd809d233', 'request_id': 'req-81adaa69-fcf5-492f-af76-d26d0dfbf184'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:22.125107 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce19b607b7a04b8baf22a01cd809d233', 'request_id': 'req-81adaa69-fcf5-492f-af76-d26d0dfbf184'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:22.131261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce19b607b7a04b8baf22a01cd809d233', 'request_id': 'req-81adaa69-fcf5-492f-af76-d26d0dfbf184'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:22.134961 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:22.183969 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1354/2746] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:13:22 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:13:22.188076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a2f6a-b014-4c9b-a361-e6b1390b00b0 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.236979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] The token cache is being invalidate because project ce19b607b7a04b8baf22a01cd809d233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:22.237267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:22.237950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-81adaa69-fcf5-492f-af76-d26d0dfbf184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:22.239828 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1393/2747] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:21 2022] DELETE /identity/v3/projects/ce19b607b7a04b8baf22a01cd809d233 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:22.244375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f9b8-9b18-4e75-a3fb-2288a20ee363 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.244658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f9b8-9b18-4e75-a3fb-2288a20ee363 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.244994 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098f9b8-9b18-4e75-a3fb-2288a20ee363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.253363 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a2f6a-b014-4c9b-a361-e6b1390b00b0 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.258209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a6d75-59d2-4db8-aaed-d17bce489889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.258963 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a6d75-59d2-4db8-aaed-d17bce489889 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.259273 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a6d75-59d2-4db8-aaed-d17bce489889 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.259550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a6d75-59d2-4db8-aaed-d17bce489889 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.260242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a6d75-59d2-4db8-aaed-d17bce489889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.262173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a6d75-59d2-4db8-aaed-d17bce489889 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.270512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-5098f9b8-9b18-4e75-a3fb-2288a20ee363 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:22.271767 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5098f9b8-9b18-4e75-a3fb-2288a20ee363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:22.280122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1394/2748] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:13:22.288412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90e72-6d2e-4230-886a-aed34363792d None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.288703 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90e72-6d2e-4230-886a-aed34363792d None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.288982 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90e72-6d2e-4230-886a-aed34363792d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.307484 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-7af90e72-6d2e-4230-886a-aed34363792d None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:22.312819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7af90e72-6d2e-4230-886a-aed34363792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:22.317598 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1395/2749] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:22.321667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90e72-6d2e-4230-886a-aed34363792d None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.331736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90e72-6d2e-4230-886a-aed34363792d None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.336851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d819ef5-fa55-4cf6-8bfc-09874d9521b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.337475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d819ef5-fa55-4cf6-8bfc-09874d9521b1 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.337764 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d819ef5-fa55-4cf6-8bfc-09874d9521b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.338074 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d819ef5-fa55-4cf6-8bfc-09874d9521b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.338785 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d819ef5-fa55-4cf6-8bfc-09874d9521b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:13:22.339150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d819ef5-fa55-4cf6-8bfc-09874d9521b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.341065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d819ef5-fa55-4cf6-8bfc-09874d9521b1 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.354215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1396/2750] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:13:22.358565 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d819ef5-fa55-4cf6-8bfc-09874d9521b1 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.368142 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d819ef5-fa55-4cf6-8bfc-09874d9521b1 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.372756 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb6eea-8758-4de3-86a8-966dab594dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.373311 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb6eea-8758-4de3-86a8-966dab594dce admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.373593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb6eea-8758-4de3-86a8-966dab594dce admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.374501 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb6eea-8758-4de3-86a8-966dab594dce admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.375225 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb6eea-8758-4de3-86a8-966dab594dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.391364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb6eea-8758-4de3-86a8-966dab594dce admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.423011 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1355/2751] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:13:22 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:13:22.426822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a6d75-59d2-4db8-aaed-d17bce489889 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.428437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-6a4a6d75-59d2-4db8-aaed-d17bce489889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:22.441183 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a6d75-59d2-4db8-aaed-d17bce489889 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.445831 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c572b8b-fbe6-4acf-b979-2e63206631b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.446470 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c572b8b-fbe6-4acf-b979-2e63206631b9 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.446756 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c572b8b-fbe6-4acf-b979-2e63206631b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.447066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c572b8b-fbe6-4acf-b979-2e63206631b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.447786 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c572b8b-fbe6-4acf-b979-2e63206631b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.449431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c572b8b-fbe6-4acf-b979-2e63206631b9 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.460155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1356/2752] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:13:22.463789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c572b8b-fbe6-4acf-b979-2e63206631b9 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.473655 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c572b8b-fbe6-4acf-b979-2e63206631b9 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.478305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b6cbb-6788-4bf2-9b17-8d6232a9f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.478918 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b6cbb-6788-4bf2-9b17-8d6232a9f1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.479231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b6cbb-6788-4bf2-9b17-8d6232a9f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.479509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b6cbb-6788-4bf2-9b17-8d6232a9f1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.480209 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b6cbb-6788-4bf2-9b17-8d6232a9f1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.481753 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b6cbb-6788-4bf2-9b17-8d6232a9f1f0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.491638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1357/2753] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:13:22.495391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b6cbb-6788-4bf2-9b17-8d6232a9f1f0 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.505518 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b6cbb-6788-4bf2-9b17-8d6232a9f1f0 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.510158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19359539-df29-47e4-ad2b-1462442399c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.510990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359539-df29-47e4-ad2b-1462442399c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.511297 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359539-df29-47e4-ad2b-1462442399c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.511575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19359539-df29-47e4-ad2b-1462442399c6 admin admin] PATH_INFO: `/v3/projects/ac4c1a2272394ebfb4d00bc4f8c97943/users/d5dda58b74184e659534bc71c6be8e52/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.526899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19359539-df29-47e4-ad2b-1462442399c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4c1a2272394ebfb4d00bc4f8c97943, user_id=d5dda58b74184e659534bc71c6be8e52, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.529613 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19359539-df29-47e4-ad2b-1462442399c6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.538192 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1397/2754] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:13:22 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:13:22.543237 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb6eea-8758-4de3-86a8-966dab594dce admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.603633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb6eea-8758-4de3-86a8-966dab594dce admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.608235 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784c77-7572-4996-8fd9-350fd3339d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.609096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784c77-7572-4996-8fd9-350fd3339d52 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.609375 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784c77-7572-4996-8fd9-350fd3339d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.609648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37784c77-7572-4996-8fd9-350fd3339d52 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.610320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37784c77-7572-4996-8fd9-350fd3339d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.612245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37784c77-7572-4996-8fd9-350fd3339d52 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.679830 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1358/2755] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:22 2022] PUT /identity/v3/projects/ac4c1a2272394ebfb4d00bc4f8c97943/users/d5dda58b74184e659534bc71c6be8e52/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:22.695300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5a8ac-0f8d-4363-8216-081f2492e335 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.695300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5a8ac-0f8d-4363-8216-081f2492e335 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.695300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5a8ac-0f8d-4363-8216-081f2492e335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.718801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-39f5a8ac-0f8d-4363-8216-081f2492e335 None None] MFA Rules not processed for user `d5dda58b74184e659534bc71c6be8e52`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:22.720048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-39f5a8ac-0f8d-4363-8216-081f2492e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:22.738606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1398/2756] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:13:22 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:13:22.743888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784c77-7572-4996-8fd9-350fd3339d52 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.755053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37784c77-7572-4996-8fd9-350fd3339d52 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.787473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1359/2757] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:13:22.805050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5a8ac-0f8d-4363-8216-081f2492e335 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.806427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-39f5a8ac-0f8d-4363-8216-081f2492e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:22.824485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f4dd-8954-4766-9441-27083accc49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.827120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f4dd-8954-4766-9441-27083accc49c admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.827120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f4dd-8954-4766-9441-27083accc49c admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.827120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7f4dd-8954-4766-9441-27083accc49c admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.827120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7f4dd-8954-4766-9441-27083accc49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.828353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7f4dd-8954-4766-9441-27083accc49c admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.838268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1399/2758] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:13:22.842540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f4dd-8954-4766-9441-27083accc49c admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.851070 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:22.852521 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7f4dd-8954-4766-9441-27083accc49c admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.857513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485a82c-c4e6-4885-9095-0f39ab9e8cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.861451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485a82c-c4e6-4885-9095-0f39ab9e8cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.861451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485a82c-c4e6-4885-9095-0f39ab9e8cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.861451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485a82c-c4e6-4885-9095-0f39ab9e8cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.861451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485a82c-c4e6-4885-9095-0f39ab9e8cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.861982 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485a82c-c4e6-4885-9095-0f39ab9e8cc8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.869704 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5a8ac-0f8d-4363-8216-081f2492e335 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.872466 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1400/2759] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:13:22.873375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ac365-3c06-4fcb-948a-5de5cfe7c8a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb36541c7ba418a843e5ecbb1f1e337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.874575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ac365-3c06-4fcb-948a-5de5cfe7c8a1 service glance] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.874856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ac365-3c06-4fcb-948a-5de5cfe7c8a1 service glance] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.875157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ac365-3c06-4fcb-948a-5de5cfe7c8a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.877123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485a82c-c4e6-4885-9095-0f39ab9e8cc8 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:22.884240 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ac365-3c06-4fcb-948a-5de5cfe7c8a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.890504 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ac365-3c06-4fcb-948a-5de5cfe7c8a1 service glance] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:22.890638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485a82c-c4e6-4885-9095-0f39ab9e8cc8 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:22.893661 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d01521-88b9-4edc-8ed0-63a75b0ce1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:22.894720 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d01521-88b9-4edc-8ed0-63a75b0ce1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:22.895026 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d01521-88b9-4edc-8ed0-63a75b0ce1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:22.895303 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d01521-88b9-4edc-8ed0-63a75b0ce1bf admin admin] PATH_INFO: `/v3/projects/247ade85ef164aa0a6345648d9645ad3/users/5c61b4bed2d54a9a9c34af1f4cdd28fc/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:22.895401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1360/2760] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:13:22.912808 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d01521-88b9-4edc-8ed0-63a75b0ce1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=247ade85ef164aa0a6345648d9645ad3, user_id=5c61b4bed2d54a9a9c34af1f4cdd28fc, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:22.915581 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d01521-88b9-4edc-8ed0-63a75b0ce1bf admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:23.023186 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:23.028816 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1401/2761] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:22 2022] PUT /identity/v3/projects/247ade85ef164aa0a6345648d9645ad3/users/5c61b4bed2d54a9a9c34af1f4cdd28fc/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:23.045652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce24f4b-ea3e-4de5-862b-a08e79b8c828 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:23.046582 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce24f4b-ea3e-4de5-862b-a08e79b8c828 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:23.046846 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce24f4b-ea3e-4de5-862b-a08e79b8c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:23.075094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-dce24f4b-ea3e-4de5-862b-a08e79b8c828 None None] MFA Rules not processed for user `5c61b4bed2d54a9a9c34af1f4cdd28fc`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:23.076288 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-dce24f4b-ea3e-4de5-862b-a08e79b8c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:23.142168 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1361/2762] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:23.146677 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d01521-88b9-4edc-8ed0-63a75b0ce1bf admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:23.208080 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d01521-88b9-4edc-8ed0-63a75b0ce1bf admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:23.212638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b889c-6251-4077-9647-0425b16d7269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:23.213323 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b889c-6251-4077-9647-0425b16d7269 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:23.213604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b889c-6251-4077-9647-0425b16d7269 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:23.213879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b889c-6251-4077-9647-0425b16d7269 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:23.214566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b889c-6251-4077-9647-0425b16d7269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:23.216738 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b889c-6251-4077-9647-0425b16d7269 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:23.326445 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1402/2763] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:13:23 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:23.330612 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce24f4b-ea3e-4de5-862b-a08e79b8c828 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:23.341614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce24f4b-ea3e-4de5-862b-a08e79b8c828 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:23.399081 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b378a-eb1b-4ecd-b600-8d07f9bd70bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:23.399744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b378a-eb1b-4ecd-b600-8d07f9bd70bb admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:23.400029 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b378a-eb1b-4ecd-b600-8d07f9bd70bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:23.400305 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b378a-eb1b-4ecd-b600-8d07f9bd70bb admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:23.400990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b378a-eb1b-4ecd-b600-8d07f9bd70bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:23.402898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b378a-eb1b-4ecd-b600-8d07f9bd70bb admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:23.537101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1362/2764] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:13:23 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:23.541079 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b889c-6251-4077-9647-0425b16d7269 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:23.551934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b889c-6251-4077-9647-0425b16d7269 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:23.556427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5cc3-3fc6-4046-8a3c-20403d1e6b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:23.557077 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5cc3-3fc6-4046-8a3c-20403d1e6b65 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:23.557359 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5cc3-3fc6-4046-8a3c-20403d1e6b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:23.557633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5cc3-3fc6-4046-8a3c-20403d1e6b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:23.558351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5cc3-3fc6-4046-8a3c-20403d1e6b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:23.560014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5cc3-3fc6-4046-8a3c-20403d1e6b65 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:23.571482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1403/2765] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:23.576086 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b378a-eb1b-4ecd-b600-8d07f9bd70bb admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:23.586607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b378a-eb1b-4ecd-b600-8d07f9bd70bb admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:23.591541 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf50ab-50cc-4c97-9bbc-1403ca0bea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:23.597720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf50ab-50cc-4c97-9bbc-1403ca0bea45 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:23.597720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf50ab-50cc-4c97-9bbc-1403ca0bea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:23.597720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf50ab-50cc-4c97-9bbc-1403ca0bea45 admin admin] PATH_INFO: `/v3/projects/9d7c7164e89d403a961fc192a873088b/users/65a947dfb900499b9c3d6c7a96606d81/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:23.608578 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf50ab-50cc-4c97-9bbc-1403ca0bea45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7c7164e89d403a961fc192a873088b, user_id=65a947dfb900499b9c3d6c7a96606d81, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:23.611441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf50ab-50cc-4c97-9bbc-1403ca0bea45 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:23.730738 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1363/2766] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:23 2022] PUT /identity/v3/projects/9d7c7164e89d403a961fc192a873088b/users/65a947dfb900499b9c3d6c7a96606d81/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:23.734861 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5cc3-3fc6-4046-8a3c-20403d1e6b65 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:23.744739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5cc3-3fc6-4046-8a3c-20403d1e6b65 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:23.799840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d793c-98ab-4cdb-9637-1bdf2dcee8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:23.800428 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d793c-98ab-4cdb-9637-1bdf2dcee8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:23.800710 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d793c-98ab-4cdb-9637-1bdf2dcee8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:23.800987 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d793c-98ab-4cdb-9637-1bdf2dcee8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:23.801702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d793c-98ab-4cdb-9637-1bdf2dcee8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:23.803326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d793c-98ab-4cdb-9637-1bdf2dcee8b7 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:23.816886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1404/2767] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:23.820576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf50ab-50cc-4c97-9bbc-1403ca0bea45 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:23.835514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf50ab-50cc-4c97-9bbc-1403ca0bea45 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:23.841361 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad78d2-7d4a-4db0-b903-d75987cd2d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:23.842456 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad78d2-7d4a-4db0-b903-d75987cd2d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:23.842638 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad78d2-7d4a-4db0-b903-d75987cd2d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:23.842887 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad78d2-7d4a-4db0-b903-d75987cd2d23 admin admin] PATH_INFO: `/v3/projects/9d7c7164e89d403a961fc192a873088b/users/65a947dfb900499b9c3d6c7a96606d81/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:23.845976 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad78d2-7d4a-4db0-b903-d75987cd2d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7c7164e89d403a961fc192a873088b, user_id=65a947dfb900499b9c3d6c7a96606d81, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:23.849294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad78d2-7d4a-4db0-b903-d75987cd2d23 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:23.862440 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1364/2768] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:23 2022] PUT /identity/v3/projects/9d7c7164e89d403a961fc192a873088b/users/65a947dfb900499b9c3d6c7a96606d81/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:23.873314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d132-7b5d-4b97-87c4-f320f3d71dae None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:23.873610 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d132-7b5d-4b97-87c4-f320f3d71dae None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:23.874758 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d132-7b5d-4b97-87c4-f320f3d71dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:23.902210 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-e4d0d132-7b5d-4b97-87c4-f320f3d71dae None None] MFA Rules not processed for user `65a947dfb900499b9c3d6c7a96606d81`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:23.903475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-e4d0d132-7b5d-4b97-87c4-f320f3d71dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:23.966429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:23.976523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1405/2769] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:23.987448 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad78d2-7d4a-4db0-b903-d75987cd2d23 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:23.989138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-39ad78d2-7d4a-4db0-b903-d75987cd2d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:23.995743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:24.048688 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad78d2-7d4a-4db0-b903-d75987cd2d23 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:24.052543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7d785-a3af-4876-a639-47ab1e0255ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:24.053066 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7d785-a3af-4876-a639-47ab1e0255ef service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:24.053347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7d785-a3af-4876-a639-47ab1e0255ef service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:24.053630 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7d785-a3af-4876-a639-47ab1e0255ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:24.110776 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7d785-a3af-4876-a639-47ab1e0255ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:24.112301 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7d785-a3af-4876-a639-47ab1e0255ef service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:24.121221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1365/2770] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:27.368485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0d132-7b5d-4b97-87c4-f320f3d71dae None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:27.370840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-e4d0d132-7b5d-4b97-87c4-f320f3d71dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:27.434090 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0d132-7b5d-4b97-87c4-f320f3d71dae None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:27.438292 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88b4ac-1c46-424d-ace1-ab2f95401001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:27.438920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88b4ac-1c46-424d-ace1-ab2f95401001 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:27.439226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88b4ac-1c46-424d-ace1-ab2f95401001 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:27.439499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88b4ac-1c46-424d-ace1-ab2f95401001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:27.441255 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9a88b4ac-1c46-424d-ace1-ab2f95401001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:27.451498 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88b4ac-1c46-424d-ace1-ab2f95401001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:27.453260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88b4ac-1c46-424d-ace1-ab2f95401001 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:27.461399 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1406/2771] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:28.313767 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7d785-a3af-4876-a639-47ab1e0255ef service cinder] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:28.378517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7d785-a3af-4876-a639-47ab1e0255ef service cinder] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:28.383369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:28.384237 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:28.384525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:28.384806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] PATH_INFO: `/v3/users/5c61b4bed2d54a9a9c34af1f4cdd28fc` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:28.385998 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c61b4bed2d54a9a9c34af1f4cdd28fc)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:28.388008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:28.613098 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c61b4bed2d54a9a9c34af1f4cdd28fc'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:28.613754 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c61b4bed2d54a9a9c34af1f4cdd28fc'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:28.614507 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c61b4bed2d54a9a9c34af1f4cdd28fc'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:28.622506 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c61b4bed2d54a9a9c34af1f4cdd28fc'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:28.627803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:28.635266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c61b4bed2d54a9a9c34af1f4cdd28fc'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:28.747856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1366/2772] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:13:28 2022] DELETE /identity/v3/users/5c61b4bed2d54a9a9c34af1f4cdd28fc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:28.753052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d5003-28ca-45b2-bdbc-f9fdc838593b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:28.753584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d5003-28ca-45b2-bdbc-f9fdc838593b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:28.753846 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d5003-28ca-45b2-bdbc-f9fdc838593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:28.772254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-486d5003-28ca-45b2-bdbc-f9fdc838593b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:28.773465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-486d5003-28ca-45b2-bdbc-f9fdc838593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:28.836076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1407/2773] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:13:28.846635 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:28.848842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:28.908025 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e8c6-81d9-4ae6-b8f8-a361172b11e4 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:28.911683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2afd8-8787-4d71-955f-42379223fc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:28.912354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2afd8-8787-4d71-955f-42379223fc09 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:28.912620 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2afd8-8787-4d71-955f-42379223fc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:28.912899 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2afd8-8787-4d71-955f-42379223fc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:28.922543 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2afd8-8787-4d71-955f-42379223fc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:28.924021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2afd8-8787-4d71-955f-42379223fc09 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:28.933548 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1367/2774] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:29.407464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d5003-28ca-45b2-bdbc-f9fdc838593b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:29.408892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-486d5003-28ca-45b2-bdbc-f9fdc838593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:29.424997 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d5003-28ca-45b2-bdbc-f9fdc838593b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:29.437843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:29.437843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:29.437843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:29.437843 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] PATH_INFO: `/v3/projects/247ade85ef164aa0a6345648d9645ad3` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:29.438615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247ade85ef164aa0a6345648d9645ad3)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:29.438615 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:29.592098 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247ade85ef164aa0a6345648d9645ad3', 'request_id': 'req-58193b67-03dd-4f53-89b4-a836e2542a13'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:29.597724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247ade85ef164aa0a6345648d9645ad3', 'request_id': 'req-58193b67-03dd-4f53-89b4-a836e2542a13'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:29.604043 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247ade85ef164aa0a6345648d9645ad3', 'request_id': 'req-58193b67-03dd-4f53-89b4-a836e2542a13'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:29.682845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] The token cache is being invalidate because project 247ade85ef164aa0a6345648d9645ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:29.683150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:29.683879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:29.685435 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1408/2775] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:29 2022] DELETE /identity/v3/projects/247ade85ef164aa0a6345648d9645ad3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:29.690132 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2afd8-8787-4d71-955f-42379223fc09 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:29.704981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2afd8-8787-4d71-955f-42379223fc09 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:29.764275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:29.765156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:29.765439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:29.765718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] PATH_INFO: `/v3/users/65a947dfb900499b9c3d6c7a96606d81` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:29.766914 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a947dfb900499b9c3d6c7a96606d81)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:29.768857 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:29.938718 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a947dfb900499b9c3d6c7a96606d81'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:29.939308 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a947dfb900499b9c3d6c7a96606d81'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:29.940039 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a947dfb900499b9c3d6c7a96606d81'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:29.946869 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a947dfb900499b9c3d6c7a96606d81'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:29.959435 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a947dfb900499b9c3d6c7a96606d81'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:30.064961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:30.069709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1368/2776] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:13:29 2022] DELETE /identity/v3/users/65a947dfb900499b9c3d6c7a96606d81 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:30.280807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:30.282312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:30.309318 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:30.411018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193b67-03dd-4f53-89b4-a836e2542a13 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:30.472564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f29e4-9844-4a13-a000-22007f94a213 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:30.473224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f29e4-9844-4a13-a000-22007f94a213 service placement] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:30.473505 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f29e4-9844-4a13-a000-22007f94a213 service placement] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:30.473779 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f29e4-9844-4a13-a000-22007f94a213 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:30.475587 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-508f29e4-9844-4a13-a000-22007f94a213 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:30.487486 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f29e4-9844-4a13-a000-22007f94a213 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:30.489057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f29e4-9844-4a13-a000-22007f94a213 service placement] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:30.501481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1409/2777] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:30.577553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:30.579060 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:30.647272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e93d2-f2c9-45a7-9440-a8a576510e93 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:30.651982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:30.652842 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:30.653119 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:30.653392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] PATH_INFO: `/v3/projects/9d7c7164e89d403a961fc192a873088b` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:30.654571 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7c7164e89d403a961fc192a873088b)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:30.657460 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:30.807526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7c7164e89d403a961fc192a873088b', 'request_id': 'req-0fe3a211-a9f8-463c-b814-7d10612dd3b0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:30.812951 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7c7164e89d403a961fc192a873088b', 'request_id': 'req-0fe3a211-a9f8-463c-b814-7d10612dd3b0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:30.819300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7c7164e89d403a961fc192a873088b', 'request_id': 'req-0fe3a211-a9f8-463c-b814-7d10612dd3b0'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:30.905329 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] The token cache is being invalidate because project 9d7c7164e89d403a961fc192a873088b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:30.905615 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:30.906264 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-0fe3a211-a9f8-463c-b814-7d10612dd3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:30.907935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1369/2778] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:30 2022] DELETE /identity/v3/projects/9d7c7164e89d403a961fc192a873088b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:30.913280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d88a22-51c7-4641-bd8f-f4cd8742c6e4 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:30.918296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d88a22-51c7-4641-bd8f-f4cd8742c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:30.918296 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d88a22-51c7-4641-bd8f-f4cd8742c6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:30.932182 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b2d88a22-51c7-4641-bd8f-f4cd8742c6e4 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:30.933411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b2d88a22-51c7-4641-bd8f-f4cd8742c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:30.994450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1410/2779] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:31.002801 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd103-ff78-45ac-88df-e36e9af565ee None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:31.003126 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd103-ff78-45ac-88df-e36e9af565ee None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:31.003408 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd103-ff78-45ac-88df-e36e9af565ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:31.021696 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-af6fd103-ff78-45ac-88df-e36e9af565ee None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:31.022891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-af6fd103-ff78-45ac-88df-e36e9af565ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:31.031282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1370/2780] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:31.035469 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d88a22-51c7-4641-bd8f-f4cd8742c6e4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:31.045162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d88a22-51c7-4641-bd8f-f4cd8742c6e4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:31.050513 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfcc51-d265-4c34-9fd5-0e70b19fbfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:31.051191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfcc51-d265-4c34-9fd5-0e70b19fbfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:31.051477 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfcc51-d265-4c34-9fd5-0e70b19fbfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:31.051754 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfcc51-d265-4c34-9fd5-0e70b19fbfa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:31.052475 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfcc51-d265-4c34-9fd5-0e70b19fbfa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:13:31.052782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfcc51-d265-4c34-9fd5-0e70b19fbfa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:31.054369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfcc51-d265-4c34-9fd5-0e70b19fbfa1 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:31.066480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1411/2781] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:13:31.070868 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd103-ff78-45ac-88df-e36e9af565ee None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:31.080828 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd103-ff78-45ac-88df-e36e9af565ee None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:31.085508 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd56b1c-5f35-451c-8440-083a298649df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:31.086167 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd56b1c-5f35-451c-8440-083a298649df admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:31.086452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd56b1c-5f35-451c-8440-083a298649df admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:31.086755 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd56b1c-5f35-451c-8440-083a298649df admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:31.087486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd56b1c-5f35-451c-8440-083a298649df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:31.089397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd56b1c-5f35-451c-8440-083a298649df admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:31.207389 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1371/2782] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:13:31 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:31.211621 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfcc51-d265-4c34-9fd5-0e70b19fbfa1 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:31.222295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfcc51-d265-4c34-9fd5-0e70b19fbfa1 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:31.241642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=100 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:31.283636 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e041a0f-2b7a-42dc-b74f-9503611b8df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:31.284368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041a0f-2b7a-42dc-b74f-9503611b8df6 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:31.284649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041a0f-2b7a-42dc-b74f-9503611b8df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:31.284918 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041a0f-2b7a-42dc-b74f-9503611b8df6 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:31.285616 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e041a0f-2b7a-42dc-b74f-9503611b8df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:31.287627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e041a0f-2b7a-42dc-b74f-9503611b8df6 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:31.399523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1412/2783] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:13:31 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:13:31.403744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd56b1c-5f35-451c-8440-083a298649df admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:31.415466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd56b1c-5f35-451c-8440-083a298649df admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:31.421150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629a15-e00b-43d2-891b-395a7d769c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:31.421517 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629a15-e00b-43d2-891b-395a7d769c22 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:31.421802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629a15-e00b-43d2-891b-395a7d769c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:31.422090 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629a15-e00b-43d2-891b-395a7d769c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:31.422807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70629a15-e00b-43d2-891b-395a7d769c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:31.424433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70629a15-e00b-43d2-891b-395a7d769c22 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:31.436004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1372/2784] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:31.444419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e041a0f-2b7a-42dc-b74f-9503611b8df6 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:31.459034 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e041a0f-2b7a-42dc-b74f-9503611b8df6 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:31.463836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d58dd5-f7df-4c05-bbaa-9b565ae5fbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:31.464543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58dd5-f7df-4c05-bbaa-9b565ae5fbae admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:31.464830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58dd5-f7df-4c05-bbaa-9b565ae5fbae admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:31.465108 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d58dd5-f7df-4c05-bbaa-9b565ae5fbae admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:31.466097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d58dd5-f7df-4c05-bbaa-9b565ae5fbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:31.468429 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d58dd5-f7df-4c05-bbaa-9b565ae5fbae admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:31.479642 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1413/2785] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:31.484756 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629a15-e00b-43d2-891b-395a7d769c22 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:31.500136 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629a15-e00b-43d2-891b-395a7d769c22 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:31.504839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf53ec4-8bdc-49b9-9ae4-4ad534a3b3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:31.505730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53ec4-8bdc-49b9-9ae4-4ad534a3b3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:31.506010 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53ec4-8bdc-49b9-9ae4-4ad534a3b3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:31.506287 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53ec4-8bdc-49b9-9ae4-4ad534a3b3e7 admin admin] PATH_INFO: `/v3/projects/0c956af48130428284b536b5c4370934/users/7c08d576e4204a74ac70d190364fb8d3/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:31.520860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf53ec4-8bdc-49b9-9ae4-4ad534a3b3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c956af48130428284b536b5c4370934, user_id=7c08d576e4204a74ac70d190364fb8d3, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:31.523563 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf53ec4-8bdc-49b9-9ae4-4ad534a3b3e7 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:31.615531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1373/2786] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:31 2022] PUT /identity/v3/projects/0c956af48130428284b536b5c4370934/users/7c08d576e4204a74ac70d190364fb8d3/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:31.630312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff674bc7-8776-4e48-9719-b1eba7f729cb None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:31.630605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff674bc7-8776-4e48-9719-b1eba7f729cb None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:31.630877 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff674bc7-8776-4e48-9719-b1eba7f729cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:31.662216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-ff674bc7-8776-4e48-9719-b1eba7f729cb None None] MFA Rules not processed for user `7c08d576e4204a74ac70d190364fb8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:31.663396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ff674bc7-8776-4e48-9719-b1eba7f729cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:31.729818 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1414/2787] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:31.741996 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf53ec4-8bdc-49b9-9ae4-4ad534a3b3e7 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:31.743728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-cdf53ec4-8bdc-49b9-9ae4-4ad534a3b3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:31.774879 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:31.804546 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf53ec4-8bdc-49b9-9ae4-4ad534a3b3e7 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:31.808431 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a595ad-57ae-40d0-b245-c1f4793013f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:31.809193 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a595ad-57ae-40d0-b245-c1f4793013f3 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:31.809576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a595ad-57ae-40d0-b245-c1f4793013f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:31.809856 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a595ad-57ae-40d0-b245-c1f4793013f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:31.819982 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a595ad-57ae-40d0-b245-c1f4793013f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:31.821450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a595ad-57ae-40d0-b245-c1f4793013f3 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:31.832347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1374/2788] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:41.726646 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=57,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:42.073407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=14 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:46.674561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff674bc7-8776-4e48-9719-b1eba7f729cb None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:46.740172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff674bc7-8776-4e48-9719-b1eba7f729cb None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:46.744698 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:46.745569 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:46.745853 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:46.746156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] PATH_INFO: `/v3/users/7c08d576e4204a74ac70d190364fb8d3` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:46.747578 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c08d576e4204a74ac70d190364fb8d3)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:46.749595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:46.972671 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c08d576e4204a74ac70d190364fb8d3'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:46.973320 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c08d576e4204a74ac70d190364fb8d3'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:46.973920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c08d576e4204a74ac70d190364fb8d3'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:47.078242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c08d576e4204a74ac70d190364fb8d3'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:47.085652 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c08d576e4204a74ac70d190364fb8d3'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:47.103472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1415/2789] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:13:46 2022] DELETE /identity/v3/users/7c08d576e4204a74ac70d190364fb8d3 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:47.108333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8181ff-3f16-4307-8cc8-809c90925e6e None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:47.108854 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8181ff-3f16-4307-8cc8-809c90925e6e None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:47.108958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8181ff-3f16-4307-8cc8-809c90925e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:47.126222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-8b8181ff-3f16-4307-8cc8-809c90925e6e None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:47.128200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8b8181ff-3f16-4307-8cc8-809c90925e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:47.184405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1375/2790] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:47.194637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:47.196052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:47.253049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8ca52-6444-4186-a4af-72836481ec35 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:47.257130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3bb8dd-7edf-470c-bb5c-309a670a8807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:47.257849 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bb8dd-7edf-470c-bb5c-309a670a8807 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:47.258151 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bb8dd-7edf-470c-bb5c-309a670a8807 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:47.258436 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3bb8dd-7edf-470c-bb5c-309a670a8807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:47.269402 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bb8dd-7edf-470c-bb5c-309a670a8807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:47.270824 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3bb8dd-7edf-470c-bb5c-309a670a8807 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:47.280613 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1416/2791] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:47.727955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8181ff-3f16-4307-8cc8-809c90925e6e None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:47.729415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-8b8181ff-3f16-4307-8cc8-809c90925e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:47.742665 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8181ff-3f16-4307-8cc8-809c90925e6e None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:47.747501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:47.748604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:47.748901 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:47.749022 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] PATH_INFO: `/v3/projects/0c956af48130428284b536b5c4370934` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:47.750104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c956af48130428284b536b5c4370934)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:47.752082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:47.884948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c956af48130428284b536b5c4370934', 'request_id': 'req-11598fb4-f410-4f24-9b19-ce967a9a0838'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:47.891142 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c956af48130428284b536b5c4370934', 'request_id': 'req-11598fb4-f410-4f24-9b19-ce967a9a0838'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:47.897372 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c956af48130428284b536b5c4370934', 'request_id': 'req-11598fb4-f410-4f24-9b19-ce967a9a0838'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:48.003137 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] The token cache is being invalidate because project 0c956af48130428284b536b5c4370934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:13:48.003430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:48.004053 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-11598fb4-f410-4f24-9b19-ce967a9a0838 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:13:48.005607 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1376/2792] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:13:47 2022] DELETE /identity/v3/projects/0c956af48130428284b536b5c4370934 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:13:48.010916 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2afac-030c-41f0-a489-1ebe90a0b396 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:48.011438 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2afac-030c-41f0-a489-1ebe90a0b396 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:48.011547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2afac-030c-41f0-a489-1ebe90a0b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:48.029400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-30d2afac-030c-41f0-a489-1ebe90a0b396 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:48.030735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-30d2afac-030c-41f0-a489-1ebe90a0b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:48.047417 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:48.091638 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1417/2793] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:13:48.099664 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17896fd7-faed-4211-ace2-26b2700d3177 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:48.100068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17896fd7-faed-4211-ace2-26b2700d3177 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:48.100306 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17896fd7-faed-4211-ace2-26b2700d3177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:48.120828 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-17896fd7-faed-4211-ace2-26b2700d3177 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:48.122092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-17896fd7-faed-4211-ace2-26b2700d3177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:48.131576 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1377/2794] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:48.135917 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2afac-030c-41f0-a489-1ebe90a0b396 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:48.146136 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2afac-030c-41f0-a489-1ebe90a0b396 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:48.150649 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51c60f-af41-476d-bc19-0d9be0938d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:48.151345 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c60f-af41-476d-bc19-0d9be0938d8a admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:48.151605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c60f-af41-476d-bc19-0d9be0938d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:48.151878 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51c60f-af41-476d-bc19-0d9be0938d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:48.152606 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51c60f-af41-476d-bc19-0d9be0938d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92064) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:13:48.152911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51c60f-af41-476d-bc19-0d9be0938d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:48.154494 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51c60f-af41-476d-bc19-0d9be0938d8a admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:48.166702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1418/2795] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 14:13:48.171414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17896fd7-faed-4211-ace2-26b2700d3177 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:48.180747 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17896fd7-faed-4211-ace2-26b2700d3177 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:48.185723 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aff5fc-1586-4761-ac13-88ab76fb7cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:48.187129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aff5fc-1586-4761-ac13-88ab76fb7cbf admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:48.187410 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aff5fc-1586-4761-ac13-88ab76fb7cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:48.187683 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aff5fc-1586-4761-ac13-88ab76fb7cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:48.188378 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aff5fc-1586-4761-ac13-88ab76fb7cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:48.190285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aff5fc-1586-4761-ac13-88ab76fb7cbf admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:48.321094 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1378/2796] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:13:48 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:13:48.324684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51c60f-af41-476d-bc19-0d9be0938d8a admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:48.334672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51c60f-af41-476d-bc19-0d9be0938d8a admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:48.393283 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643c987-bdb3-47b6-833a-d7b7efc72ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:48.393953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643c987-bdb3-47b6-833a-d7b7efc72ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:48.394238 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643c987-bdb3-47b6-833a-d7b7efc72ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:48.394520 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643c987-bdb3-47b6-833a-d7b7efc72ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:48.395246 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643c987-bdb3-47b6-833a-d7b7efc72ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:48.397175 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643c987-bdb3-47b6-833a-d7b7efc72ff2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:48.490915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1419/2797] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:13:48 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:13:48.495032 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aff5fc-1586-4761-ac13-88ab76fb7cbf admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:48.506711 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aff5fc-1586-4761-ac13-88ab76fb7cbf admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:48.511501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6e950-9e96-49f2-ad6e-d80477326cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:48.512190 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e950-9e96-49f2-ad6e-d80477326cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:48.512476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e950-9e96-49f2-ad6e-d80477326cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:48.512761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e950-9e96-49f2-ad6e-d80477326cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:48.513486 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6e950-9e96-49f2-ad6e-d80477326cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:48.515430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6e950-9e96-49f2-ad6e-d80477326cf9 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:48.525896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1379/2798] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:48.530348 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643c987-bdb3-47b6-833a-d7b7efc72ff2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:48.541158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643c987-bdb3-47b6-833a-d7b7efc72ff2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:48.546385 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46268278-6ea0-4357-9b32-5d93aec5c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:48.547236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268278-6ea0-4357-9b32-5d93aec5c59e admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:48.547527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268278-6ea0-4357-9b32-5d93aec5c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:48.547807 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46268278-6ea0-4357-9b32-5d93aec5c59e admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:48.548608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46268278-6ea0-4357-9b32-5d93aec5c59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:48.550114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46268278-6ea0-4357-9b32-5d93aec5c59e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:48.560741 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1420/2799] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:13:48.565452 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6e950-9e96-49f2-ad6e-d80477326cf9 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:48.575437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6e950-9e96-49f2-ad6e-d80477326cf9 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:48.580483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96b2d9-f8e1-4619-979f-511b0673c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:48.581392 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96b2d9-f8e1-4619-979f-511b0673c8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:48.581679 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96b2d9-f8e1-4619-979f-511b0673c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:48.581959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96b2d9-f8e1-4619-979f-511b0673c8fb admin admin] PATH_INFO: `/v3/projects/1bf9f2e60dda4e8494b5f641415f403f/users/e72330f8a3804e8f83aa01182547074d/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:48.598623 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96b2d9-f8e1-4619-979f-511b0673c8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf9f2e60dda4e8494b5f641415f403f, user_id=e72330f8a3804e8f83aa01182547074d, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:48.601369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96b2d9-f8e1-4619-979f-511b0673c8fb admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:48.720406 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1380/2800] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:13:48 2022] PUT /identity/v3/projects/1bf9f2e60dda4e8494b5f641415f403f/users/e72330f8a3804e8f83aa01182547074d/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:13:48.730998 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cebae-e614-4877-8f13-79ecc2d84997 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:48.731294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cebae-e614-4877-8f13-79ecc2d84997 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:48.731575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cebae-e614-4877-8f13-79ecc2d84997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:48.759982 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-c48cebae-e614-4877-8f13-79ecc2d84997 None None] MFA Rules not processed for user `e72330f8a3804e8f83aa01182547074d`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:48.761208 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c48cebae-e614-4877-8f13-79ecc2d84997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:48.828856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1421/2801] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:48.839713 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96b2d9-f8e1-4619-979f-511b0673c8fb admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:48.841804 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-cd96b2d9-f8e1-4619-979f-511b0673c8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:48.865509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:48.901353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96b2d9-f8e1-4619-979f-511b0673c8fb admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:48.905643 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafc746-f089-4995-90aa-aa2b0f658869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:48.906380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafc746-f089-4995-90aa-aa2b0f658869 service cinder] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:48.906657 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafc746-f089-4995-90aa-aa2b0f658869 service cinder] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:48.906926 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafc746-f089-4995-90aa-aa2b0f658869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:48.915266 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafc746-f089-4995-90aa-aa2b0f658869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:48.916693 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafc746-f089-4995-90aa-aa2b0f658869 service cinder] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:48.925652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1381/2802] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:53.833082 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cebae-e614-4877-8f13-79ecc2d84997 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:53.834687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c48cebae-e614-4877-8f13-79ecc2d84997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:53.856774 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:13:53.936540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cebae-e614-4877-8f13-79ecc2d84997 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:53.942662 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c3426-ee62-4984-8d73-2cf1d1381d17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:53.943355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c3426-ee62-4984-8d73-2cf1d1381d17 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:53.943651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c3426-ee62-4984-8d73-2cf1d1381d17 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:53.943925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c3426-ee62-4984-8d73-2cf1d1381d17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:53.946197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-402c3426-ee62-4984-8d73-2cf1d1381d17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:53.959137 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c3426-ee62-4984-8d73-2cf1d1381d17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:53.960733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c3426-ee62-4984-8d73-2cf1d1381d17 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:53.972514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1422/2803] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:13:54.865194 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1caf-5aa1-4177-8bb2-139fbf5dd6e9 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:54.865717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1caf-5aa1-4177-8bb2-139fbf5dd6e9 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:54.865845 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1caf-5aa1-4177-8bb2-139fbf5dd6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:54.883445 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-298d1caf-5aa1-4177-8bb2-139fbf5dd6e9 None None] MFA Rules not processed for user `e72330f8a3804e8f83aa01182547074d`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:13:54.884642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-298d1caf-5aa1-4177-8bb2-139fbf5dd6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:54.892374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1382/2804] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:13:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:13:58.251805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c3426-ee62-4984-8d73-2cf1d1381d17 service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:13:58.253224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-402c3426-ee62-4984-8d73-2cf1d1381d17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:58.310542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c3426-ee62-4984-8d73-2cf1d1381d17 service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:13:58.314888 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d03d11-61d0-4988-a4f1-6fb7b19faceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:13:58.315561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d03d11-61d0-4988-a4f1-6fb7b19faceb service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:13:58.315847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d03d11-61d0-4988-a4f1-6fb7b19faceb service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:13:58.316126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d03d11-61d0-4988-a4f1-6fb7b19faceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:13:58.317905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-41d03d11-61d0-4988-a4f1-6fb7b19faceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:13:58.381431 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d03d11-61d0-4988-a4f1-6fb7b19faceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:13:58.382854 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d03d11-61d0-4988-a4f1-6fb7b19faceb service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:13:58.393144 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1423/2805] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:13:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:14:04.878499 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=20 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:08.387986 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=88 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:11.216673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d1caf-5aa1-4177-8bb2-139fbf5dd6e9 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:11.218462 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-298d1caf-5aa1-4177-8bb2-139fbf5dd6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:11.282852 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d1caf-5aa1-4177-8bb2-139fbf5dd6e9 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:11.287322 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:11.288185 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:11.288466 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:11.288739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] PATH_INFO: `/v3/users/d5dda58b74184e659534bc71c6be8e52` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:11.289907 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5dda58b74184e659534bc71c6be8e52)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:11.291850 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:11.572537 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5dda58b74184e659534bc71c6be8e52'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:11.573195 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5dda58b74184e659534bc71c6be8e52'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:11.573796 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5dda58b74184e659534bc71c6be8e52'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:11.580908 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5dda58b74184e659534bc71c6be8e52'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:11.592959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5dda58b74184e659534bc71c6be8e52'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:11.704169 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1383/2806] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:14:11 2022] DELETE /identity/v3/users/d5dda58b74184e659534bc71c6be8e52 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:11.707110 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf88caa-dddb-4eed-ae3c-b091da87986a None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:11.707620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf88caa-dddb-4eed-ae3c-b091da87986a None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:11.707735 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf88caa-dddb-4eed-ae3c-b091da87986a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:11.725010 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-cbf88caa-dddb-4eed-ae3c-b091da87986a None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:11.726229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cbf88caa-dddb-4eed-ae3c-b091da87986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:11.792030 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1424/2807] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:14:11.802258 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:11.803702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:11.861649 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2381b3-cfce-4943-bfd5-417bb32773ef admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:11.865214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1467f2-67eb-463f-bf4e-5b3f79dbe7cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:11.865858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1467f2-67eb-463f-bf4e-5b3f79dbe7cb service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:11.870988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1467f2-67eb-463f-bf4e-5b3f79dbe7cb service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:11.870988 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1467f2-67eb-463f-bf4e-5b3f79dbe7cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:11.875509 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1467f2-67eb-463f-bf4e-5b3f79dbe7cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:11.876944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1467f2-67eb-463f-bf4e-5b3f79dbe7cb service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:11.886498 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1384/2808] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:14:12.376993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf88caa-dddb-4eed-ae3c-b091da87986a None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:12.378995 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-cbf88caa-dddb-4eed-ae3c-b091da87986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:12.395174 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf88caa-dddb-4eed-ae3c-b091da87986a None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:12.400245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:12.401411 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:12.401895 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:12.402294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] PATH_INFO: `/v3/projects/ac4c1a2272394ebfb4d00bc4f8c97943` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:12.403737 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4c1a2272394ebfb4d00bc4f8c97943)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:12.408096 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:12.549052 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4c1a2272394ebfb4d00bc4f8c97943', 'request_id': 'req-fadb0778-4f90-435e-8ffd-182215246bec'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:12.554771 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4c1a2272394ebfb4d00bc4f8c97943', 'request_id': 'req-fadb0778-4f90-435e-8ffd-182215246bec'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:12.561688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4c1a2272394ebfb4d00bc4f8c97943', 'request_id': 'req-fadb0778-4f90-435e-8ffd-182215246bec'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:12.637450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] The token cache is being invalidate because project ac4c1a2272394ebfb4d00bc4f8c97943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:14:12.637667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:12.638284 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-fadb0778-4f90-435e-8ffd-182215246bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:12.639892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1425/2809] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:14:12 2022] DELETE /identity/v3/projects/ac4c1a2272394ebfb4d00bc4f8c97943 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:12.644631 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b8e9b-3476-40ab-a69f-ec020e790875 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:12.645115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b8e9b-3476-40ab-a69f-ec020e790875 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:12.645223 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b8e9b-3476-40ab-a69f-ec020e790875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:12.663919 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-f53b8e9b-3476-40ab-a69f-ec020e790875 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:12.665121 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-f53b8e9b-3476-40ab-a69f-ec020e790875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:12.683076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:12.725806 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1385/2810] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:12.734829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a4cd8-b0d4-4378-a78b-6273eb58e65b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:12.735357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a4cd8-b0d4-4378-a78b-6273eb58e65b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:12.735472 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a4cd8-b0d4-4378-a78b-6273eb58e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:12.753525 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-563a4cd8-b0d4-4378-a78b-6273eb58e65b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:12.754748 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-563a4cd8-b0d4-4378-a78b-6273eb58e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:12.762938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1426/2811] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:12.767151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b8e9b-3476-40ab-a69f-ec020e790875 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:12.776534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b8e9b-3476-40ab-a69f-ec020e790875 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:12.781739 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067263b-ce9a-4da1-85b4-bc30c72fa84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:12.782395 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067263b-ce9a-4da1-85b4-bc30c72fa84c admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:12.782680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067263b-ce9a-4da1-85b4-bc30c72fa84c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:12.782956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067263b-ce9a-4da1-85b4-bc30c72fa84c admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:12.783701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067263b-ce9a-4da1-85b4-bc30c72fa84c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:14:12.784012 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067263b-ce9a-4da1-85b4-bc30c72fa84c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:12.785618 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067263b-ce9a-4da1-85b4-bc30c72fa84c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:12.797774 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1386/2812] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:14:12.801925 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a4cd8-b0d4-4378-a78b-6273eb58e65b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:12.811018 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a4cd8-b0d4-4378-a78b-6273eb58e65b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:12.815709 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239df68-278f-4caa-932d-ab5b3d091ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:12.816353 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239df68-278f-4caa-932d-ab5b3d091ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:12.816633 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239df68-278f-4caa-932d-ab5b3d091ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:12.816905 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239df68-278f-4caa-932d-ab5b3d091ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:12.817593 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239df68-278f-4caa-932d-ab5b3d091ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:12.819537 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239df68-278f-4caa-932d-ab5b3d091ad2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:12.957934 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1427/2813] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:14:12 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:14:12.962042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067263b-ce9a-4da1-85b4-bc30c72fa84c admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:12.972268 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067263b-ce9a-4da1-85b4-bc30c72fa84c admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:13.028110 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6da0d-6ac5-4725-a42a-cb98c470ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:13.028781 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6da0d-6ac5-4725-a42a-cb98c470ed6b admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:13.029063 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6da0d-6ac5-4725-a42a-cb98c470ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:13.029374 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6da0d-6ac5-4725-a42a-cb98c470ed6b admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:13.030300 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6da0d-6ac5-4725-a42a-cb98c470ed6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:13.032246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c6da0d-6ac5-4725-a42a-cb98c470ed6b admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:13.313103 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1387/2814] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:14:12 2022] POST /identity/v3/users => generated 295 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:14:13.317187 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239df68-278f-4caa-932d-ab5b3d091ad2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:13.327546 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239df68-278f-4caa-932d-ab5b3d091ad2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:13.332051 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001eb8-07e7-41e3-baa1-53adfa9f5b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:13.332707 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001eb8-07e7-41e3-baa1-53adfa9f5b2e admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:13.332990 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001eb8-07e7-41e3-baa1-53adfa9f5b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:13.333269 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00001eb8-07e7-41e3-baa1-53adfa9f5b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:13.334053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001eb8-07e7-41e3-baa1-53adfa9f5b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:13.335608 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00001eb8-07e7-41e3-baa1-53adfa9f5b2e admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:13.347268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1428/2815] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:14:13.351367 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6da0d-6ac5-4725-a42a-cb98c470ed6b admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:13.362566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6da0d-6ac5-4725-a42a-cb98c470ed6b admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:13.367285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edd005-cdb3-49a4-bea4-5a591fc73c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:13.367948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd005-cdb3-49a4-bea4-5a591fc73c71 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:13.368231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd005-cdb3-49a4-bea4-5a591fc73c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:13.368507 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edd005-cdb3-49a4-bea4-5a591fc73c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:13.369312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edd005-cdb3-49a4-bea4-5a591fc73c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:13.370890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edd005-cdb3-49a4-bea4-5a591fc73c71 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:13.381962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1388/2816] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:14:13.385702 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001eb8-07e7-41e3-baa1-53adfa9f5b2e admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:13.395924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00001eb8-07e7-41e3-baa1-53adfa9f5b2e admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:13.400502 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dbe41-f444-402f-90dc-6251490a3630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:13.401381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dbe41-f444-402f-90dc-6251490a3630 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:13.401668 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dbe41-f444-402f-90dc-6251490a3630 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:13.401940 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dbe41-f444-402f-90dc-6251490a3630 admin admin] PATH_INFO: `/v3/projects/35748db258fe475682325e4226c21b36/users/034b3a095a5d495281cf07d13821ada1/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:13.417213 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441dbe41-f444-402f-90dc-6251490a3630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35748db258fe475682325e4226c21b36, user_id=034b3a095a5d495281cf07d13821ada1, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:13.420099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441dbe41-f444-402f-90dc-6251490a3630 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:13.548355 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1429/2817] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:14:13 2022] PUT /identity/v3/projects/35748db258fe475682325e4226c21b36/users/034b3a095a5d495281cf07d13821ada1/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:13.559227 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4dd82-3ae9-475a-baf5-72cb3044330a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:13.559534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4dd82-3ae9-475a-baf5-72cb3044330a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:13.559813 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4dd82-3ae9-475a-baf5-72cb3044330a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:13.586312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-a8e4dd82-3ae9-475a-baf5-72cb3044330a None None] MFA Rules not processed for user `034b3a095a5d495281cf07d13821ada1`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:13.587469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a8e4dd82-3ae9-475a-baf5-72cb3044330a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:13.653530 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1389/2818] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:13.664950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dbe41-f444-402f-90dc-6251490a3630 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:13.666747 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-441dbe41-f444-402f-90dc-6251490a3630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:13.689627 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:13.725777 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dbe41-f444-402f-90dc-6251490a3630 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:13.729575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d2059-74d2-4b53-aa73-03bb58f853a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:13.730218 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d2059-74d2-4b53-aa73-03bb58f853a4 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:13.730499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d2059-74d2-4b53-aa73-03bb58f853a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:13.730768 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d2059-74d2-4b53-aa73-03bb58f853a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:13.739295 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d2059-74d2-4b53-aa73-03bb58f853a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:13.740840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d2059-74d2-4b53-aa73-03bb58f853a4 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:13.749550 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1430/2819] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:14:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:14:23.650550 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:24.124805 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=17 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:27.980036 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106df0f7-943a-453c-9123-f7c54e08f59a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:27.980501 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106df0f7-943a-453c-9123-f7c54e08f59a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:27.980659 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106df0f7-943a-453c-9123-f7c54e08f59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:28.008896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-106df0f7-943a-453c-9123-f7c54e08f59a None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:28.010084 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-106df0f7-943a-453c-9123-f7c54e08f59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:28.065575 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1390/2820] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:28.209001 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d2059-74d2-4b53-aa73-03bb58f853a4 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:28.210425 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-da1d2059-74d2-4b53-aa73-03bb58f853a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:28.279996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d2059-74d2-4b53-aa73-03bb58f853a4 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:28.284939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21767bfe-f788-43e4-844a-5dad71c6602c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:28.285585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767bfe-f788-43e4-844a-5dad71c6602c service swift] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:28.285862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767bfe-f788-43e4-844a-5dad71c6602c service swift] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:28.286133 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21767bfe-f788-43e4-844a-5dad71c6602c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:28.294099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21767bfe-f788-43e4-844a-5dad71c6602c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:28.295722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21767bfe-f788-43e4-844a-5dad71c6602c service swift] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:28.304067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1431/2821] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:14:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:14:29.206533 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76656da4-1bf6-48e8-85ff-1973acff3dfb None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:29.207035 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76656da4-1bf6-48e8-85ff-1973acff3dfb None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:29.207151 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76656da4-1bf6-48e8-85ff-1973acff3dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:29.225393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-76656da4-1bf6-48e8-85ff-1973acff3dfb None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:29.226595 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-76656da4-1bf6-48e8-85ff-1973acff3dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:29.234189 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1391/2822] 10.222.0.42 () {58 vars in 967 bytes} [Fri May 27 14:14:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:29.247187 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21767bfe-f788-43e4-844a-5dad71c6602c service swift] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:29.258078 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21767bfe-f788-43e4-844a-5dad71c6602c service swift] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:29.263414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768ec32-02f5-495f-b9fa-a63f0dcd7c73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:29.264953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768ec32-02f5-495f-b9fa-a63f0dcd7c73 service swift] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:29.265242 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768ec32-02f5-495f-b9fa-a63f0dcd7c73 service swift] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:29.265605 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768ec32-02f5-495f-b9fa-a63f0dcd7c73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:29.273851 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768ec32-02f5-495f-b9fa-a63f0dcd7c73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:29.275482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768ec32-02f5-495f-b9fa-a63f0dcd7c73 service swift] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:29.284091 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1432/2823] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:14:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:14:30.048353 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d89617-c4c2-4cf1-a156-ac4ad7a4818b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:30.048641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d89617-c4c2-4cf1-a156-ac4ad7a4818b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:30.048938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d89617-c4c2-4cf1-a156-ac4ad7a4818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:30.067241 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-d8d89617-c4c2-4cf1-a156-ac4ad7a4818b None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:30.068439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d8d89617-c4c2-4cf1-a156-ac4ad7a4818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:30.075586 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1392/2824] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:30.088076 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768ec32-02f5-495f-b9fa-a63f0dcd7c73 service swift] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:30.101141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768ec32-02f5-495f-b9fa-a63f0dcd7c73 service swift] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:30.106310 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5384-7a88-4ac0-8fa3-875a9e4e072d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:30.106949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5384-7a88-4ac0-8fa3-875a9e4e072d service swift] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:30.107294 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5384-7a88-4ac0-8fa3-875a9e4e072d service swift] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:30.107736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a5384-7a88-4ac0-8fa3-875a9e4e072d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:30.122733 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a5384-7a88-4ac0-8fa3-875a9e4e072d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:30.125022 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a5384-7a88-4ac0-8fa3-875a9e4e072d service swift] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:30.133368 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1433/2825] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:14:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:14:30.924233 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e08c-eb8a-4a99-a554-e39f4c4ae89c None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:30.924708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e08c-eb8a-4a99-a554-e39f4c4ae89c None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:30.924803 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e08c-eb8a-4a99-a554-e39f4c4ae89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:30.943000 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-b857e08c-eb8a-4a99-a554-e39f4c4ae89c None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:30.944200 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b857e08c-eb8a-4a99-a554-e39f4c4ae89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:30.951294 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1393/2826] 10.222.0.42 () {58 vars in 967 bytes} [Fri May 27 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:30.963299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5384-7a88-4ac0-8fa3-875a9e4e072d service swift] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:30.974277 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a5384-7a88-4ac0-8fa3-875a9e4e072d service swift] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:30.979215 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d581ef8-20f0-4f4d-8ffa-b7a88d9acb26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:30.979841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d581ef8-20f0-4f4d-8ffa-b7a88d9acb26 service swift] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:30.980123 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d581ef8-20f0-4f4d-8ffa-b7a88d9acb26 service swift] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:30.980396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d581ef8-20f0-4f4d-8ffa-b7a88d9acb26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:30.988972 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d581ef8-20f0-4f4d-8ffa-b7a88d9acb26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:30.990531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d581ef8-20f0-4f4d-8ffa-b7a88d9acb26 service swift] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:30.999622 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1434/2827] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:14:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:14:33.844547 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e08c-eb8a-4a99-a554-e39f4c4ae89c None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:33.846068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b857e08c-eb8a-4a99-a554-e39f4c4ae89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:33.922876 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e08c-eb8a-4a99-a554-e39f4c4ae89c None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:33.927500 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:33.928375 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:33.928660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:33.928942 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] PATH_INFO: `/v3/users/e72330f8a3804e8f83aa01182547074d` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:33.930156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72330f8a3804e8f83aa01182547074d)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:33.932139 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:34.201164 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72330f8a3804e8f83aa01182547074d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:34.201839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72330f8a3804e8f83aa01182547074d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:34.202510 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72330f8a3804e8f83aa01182547074d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:34.210485 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72330f8a3804e8f83aa01182547074d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:34.224235 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72330f8a3804e8f83aa01182547074d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:34.228079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:34.368633 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1394/2828] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:14:33 2022] DELETE /identity/v3/users/e72330f8a3804e8f83aa01182547074d => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:34.371769 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44ce8c-6757-4969-8aa1-12e7f322c521 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:34.372275 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44ce8c-6757-4969-8aa1-12e7f322c521 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:34.372391 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44ce8c-6757-4969-8aa1-12e7f322c521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:34.391656 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-bd44ce8c-6757-4969-8aa1-12e7f322c521 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:34.392873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bd44ce8c-6757-4969-8aa1-12e7f322c521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:34.457612 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1435/2829] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:34.469184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:34.470661 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:34.528950 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d32e40-7133-4b9a-a246-bd963affce2f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:34.532777 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3202e84-e2e3-4376-bd22-f4818290cab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:34.533425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3202e84-e2e3-4376-bd22-f4818290cab3 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:34.533710 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3202e84-e2e3-4376-bd22-f4818290cab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:34.533990 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3202e84-e2e3-4376-bd22-f4818290cab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:34.543338 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3202e84-e2e3-4376-bd22-f4818290cab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:34.545161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3202e84-e2e3-4376-bd22-f4818290cab3 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:34.555405 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1395/2830] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:14:34.823955 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44ce8c-6757-4969-8aa1-12e7f322c521 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:34.825410 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-bd44ce8c-6757-4969-8aa1-12e7f322c521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:34.839414 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44ce8c-6757-4969-8aa1-12e7f322c521 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:34.844866 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:34.845719 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:34.846000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:34.846273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] PATH_INFO: `/v3/projects/1bf9f2e60dda4e8494b5f641415f403f` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:34.847533 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf9f2e60dda4e8494b5f641415f403f)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:34.849479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:34.997158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:35.000751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf9f2e60dda4e8494b5f641415f403f', 'request_id': 'req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:35.006195 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf9f2e60dda4e8494b5f641415f403f', 'request_id': 'req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:35.012260 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf9f2e60dda4e8494b5f641415f403f', 'request_id': 'req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:35.100512 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] The token cache is being invalidate because project 1bf9f2e60dda4e8494b5f641415f403f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:14:35.100781 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:35.101405 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-db5f9c73-f7d9-4a67-aa9d-5ba90afeb051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:35.102989 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1436/2831] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:14:34 2022] DELETE /identity/v3/projects/1bf9f2e60dda4e8494b5f641415f403f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:35.108113 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81099508-a8d5-4410-8c56-b9d586ecfa64 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:35.108618 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81099508-a8d5-4410-8c56-b9d586ecfa64 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:35.108737 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81099508-a8d5-4410-8c56-b9d586ecfa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:35.126453 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-81099508-a8d5-4410-8c56-b9d586ecfa64 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:35.127680 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-81099508-a8d5-4410-8c56-b9d586ecfa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:35.188411 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1396/2832] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:35.196653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986d882-8b61-4582-9a67-ab001416919b None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:35.196937 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986d882-8b61-4582-9a67-ab001416919b None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:35.197214 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986d882-8b61-4582-9a67-ab001416919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:35.216793 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-5986d882-8b61-4582-9a67-ab001416919b None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:35.218263 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-5986d882-8b61-4582-9a67-ab001416919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:35.226305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1437/2833] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:35.230391 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81099508-a8d5-4410-8c56-b9d586ecfa64 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:35.240230 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81099508-a8d5-4410-8c56-b9d586ecfa64 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:35.244946 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38bd91-7ba3-45d4-8fdb-176d9568a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:35.246626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38bd91-7ba3-45d4-8fdb-176d9568a79f admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:35.246626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38bd91-7ba3-45d4-8fdb-176d9568a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:35.246626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38bd91-7ba3-45d4-8fdb-176d9568a79f admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:35.247078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38bd91-7ba3-45d4-8fdb-176d9568a79f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:14:35.247446 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38bd91-7ba3-45d4-8fdb-176d9568a79f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:35.249603 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd38bd91-7ba3-45d4-8fdb-176d9568a79f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:35.261304 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1397/2834] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:14:35.266024 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986d882-8b61-4582-9a67-ab001416919b None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:35.275191 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986d882-8b61-4582-9a67-ab001416919b None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:35.280200 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e664419-724d-4a8d-8e7c-7abb234bdb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:35.280847 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e664419-724d-4a8d-8e7c-7abb234bdb0d admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:35.281132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e664419-724d-4a8d-8e7c-7abb234bdb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:35.281407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e664419-724d-4a8d-8e7c-7abb234bdb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:35.282089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e664419-724d-4a8d-8e7c-7abb234bdb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:35.284166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e664419-724d-4a8d-8e7c-7abb234bdb0d admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:35.497055 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1438/2835] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:14:35 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:14:35.505652 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38bd91-7ba3-45d4-8fdb-176d9568a79f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:35.515702 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38bd91-7ba3-45d4-8fdb-176d9568a79f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:35.572853 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64997e-9020-493d-8516-8914210ed85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:35.573531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64997e-9020-493d-8516-8914210ed85f admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:35.573818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64997e-9020-493d-8516-8914210ed85f admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:35.574102 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64997e-9020-493d-8516-8914210ed85f admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:35.574800 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64997e-9020-493d-8516-8914210ed85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:35.577285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64997e-9020-493d-8516-8914210ed85f admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:35.655592 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1398/2836] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:14:35 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:14:35.659663 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e664419-724d-4a8d-8e7c-7abb234bdb0d admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:35.670315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e664419-724d-4a8d-8e7c-7abb234bdb0d admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:35.675126 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13d5f5-d0a8-4aa3-8337-51922172a2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:35.675786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13d5f5-d0a8-4aa3-8337-51922172a2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:35.676067 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13d5f5-d0a8-4aa3-8337-51922172a2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:35.676342 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13d5f5-d0a8-4aa3-8337-51922172a2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:35.677059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13d5f5-d0a8-4aa3-8337-51922172a2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:35.678643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13d5f5-d0a8-4aa3-8337-51922172a2b5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:35.690124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1439/2837] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:14:35.694476 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64997e-9020-493d-8516-8914210ed85f admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:35.704703 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64997e-9020-493d-8516-8914210ed85f admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:35.709358 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b0645-2a74-417f-99d5-946a9643e819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:35.713469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b0645-2a74-417f-99d5-946a9643e819 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:35.713469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b0645-2a74-417f-99d5-946a9643e819 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:35.713469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b0645-2a74-417f-99d5-946a9643e819 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:35.713469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b0645-2a74-417f-99d5-946a9643e819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:35.713469 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b0645-2a74-417f-99d5-946a9643e819 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:35.725427 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1399/2838] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:14:35.728120 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13d5f5-d0a8-4aa3-8337-51922172a2b5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:35.739861 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13d5f5-d0a8-4aa3-8337-51922172a2b5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:35.744639 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d64f7-1301-4a33-86ba-818c9a52e761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:35.745514 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d64f7-1301-4a33-86ba-818c9a52e761 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:35.745790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d64f7-1301-4a33-86ba-818c9a52e761 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:35.746060 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d64f7-1301-4a33-86ba-818c9a52e761 admin admin] PATH_INFO: `/v3/projects/3db847e7be094f10a4ff9bd34960b6cc/users/7c43c1a675ed4a3587e8bcbad0b95fc9/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:35.762101 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d64f7-1301-4a33-86ba-818c9a52e761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db847e7be094f10a4ff9bd34960b6cc, user_id=7c43c1a675ed4a3587e8bcbad0b95fc9, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:35.765011 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d64f7-1301-4a33-86ba-818c9a52e761 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:35.849746 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1440/2839] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:14:35 2022] PUT /identity/v3/projects/3db847e7be094f10a4ff9bd34960b6cc/users/7c43c1a675ed4a3587e8bcbad0b95fc9/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 14:14:35.854922 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211160d-27db-42d6-933c-9415a10b0d42 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:35.855250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211160d-27db-42d6-933c-9415a10b0d42 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:35.855522 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211160d-27db-42d6-933c-9415a10b0d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:35.863042 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:35.878321 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-b211160d-27db-42d6-933c-9415a10b0d42 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:35.879745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b211160d-27db-42d6-933c-9415a10b0d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:35.943890 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1400/2840] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:35.953667 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d64f7-1301-4a33-86ba-818c9a52e761 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:35.955671 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6b2d64f7-1301-4a33-86ba-818c9a52e761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:36.012836 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d64f7-1301-4a33-86ba-818c9a52e761 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:36.016626 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0855b7-e1d1-46e4-8a08-1b1f87438213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:36.017268 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0855b7-e1d1-46e4-8a08-1b1f87438213 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:36.017549 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0855b7-e1d1-46e4-8a08-1b1f87438213 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:36.017840 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0855b7-e1d1-46e4-8a08-1b1f87438213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:36.027000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0855b7-e1d1-46e4-8a08-1b1f87438213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:36.028465 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0855b7-e1d1-46e4-8a08-1b1f87438213 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:36.038367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1441/2841] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:14:39.432944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211160d-27db-42d6-933c-9415a10b0d42 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:39.436818 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-b211160d-27db-42d6-933c-9415a10b0d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:39.455729 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211160d-27db-42d6-933c-9415a10b0d42 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:39.462929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:39.463939 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:39.464247 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:39.465252 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] PATH_INFO: `/v3/users/034b3a095a5d495281cf07d13821ada1` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:39.467593 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=034b3a095a5d495281cf07d13821ada1)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:39.470817 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:39.736808 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '034b3a095a5d495281cf07d13821ada1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:39.737482 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '034b3a095a5d495281cf07d13821ada1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:39.738099 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '034b3a095a5d495281cf07d13821ada1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:39.746263 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '034b3a095a5d495281cf07d13821ada1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:39.761722 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '034b3a095a5d495281cf07d13821ada1'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:39.916642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1401/2842] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:14:39 2022] DELETE /identity/v3/users/034b3a095a5d495281cf07d13821ada1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:39.918267 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d86939-1d05-4512-b4ce-a43847bc36b4 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:39.919102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d86939-1d05-4512-b4ce-a43847bc36b4 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:39.919102 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d86939-1d05-4512-b4ce-a43847bc36b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:39.938141 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-b1d86939-1d05-4512-b4ce-a43847bc36b4 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:39.939535 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b1d86939-1d05-4512-b4ce-a43847bc36b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:40.010297 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1442/2843] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 14:14:40.019961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:40.021369 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:40.085430 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ee7e0-f430-484e-85d6-d2e4796566a0 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:40.092724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8e226-39b3-4079-8fc6-f5d58add1e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:40.092724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8e226-39b3-4079-8fc6-f5d58add1e4f service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:40.092724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8e226-39b3-4079-8fc6-f5d58add1e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:40.092724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8e226-39b3-4079-8fc6-f5d58add1e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:40.102432 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8e226-39b3-4079-8fc6-f5d58add1e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:40.103955 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8e226-39b3-4079-8fc6-f5d58add1e4f service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:40.114934 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1402/2844] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:14:40.591056 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d86939-1d05-4512-b4ce-a43847bc36b4 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:40.593406 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b1d86939-1d05-4512-b4ce-a43847bc36b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:40.611162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d86939-1d05-4512-b4ce-a43847bc36b4 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:40.618634 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:40.621604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:40.621604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:40.621604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] PATH_INFO: `/v3/projects/35748db258fe475682325e4226c21b36` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:40.621604 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=35748db258fe475682325e4226c21b36)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:40.624942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:40.640358 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:40.773482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35748db258fe475682325e4226c21b36', 'request_id': 'req-c8279214-932f-441c-a0fd-2ed5d6f18cfd'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:40.780597 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35748db258fe475682325e4226c21b36', 'request_id': 'req-c8279214-932f-441c-a0fd-2ed5d6f18cfd'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:40.788722 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35748db258fe475682325e4226c21b36', 'request_id': 'req-c8279214-932f-441c-a0fd-2ed5d6f18cfd'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:40.920381 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] The token cache is being invalidate because project 35748db258fe475682325e4226c21b36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:14:40.921059 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:40.921909 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-c8279214-932f-441c-a0fd-2ed5d6f18cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:14:40.923571 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1443/2845] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:14:40 2022] DELETE /identity/v3/projects/35748db258fe475682325e4226c21b36 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:40.929043 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f00bbe-a1e3-4b2c-910e-f670236a7d15 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:40.929471 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f00bbe-a1e3-4b2c-910e-f670236a7d15 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:40.929642 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f00bbe-a1e3-4b2c-910e-f670236a7d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:40.948666 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-d0f00bbe-a1e3-4b2c-910e-f670236a7d15 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:40.949929 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d0f00bbe-a1e3-4b2c-910e-f670236a7d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:40.964354 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:41.013438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1403/2846] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:41.021705 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d72b-70ad-430a-884d-c3d1d9fad868 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:41.024315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d72b-70ad-430a-884d-c3d1d9fad868 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:41.024315 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009d72b-70ad-430a-884d-c3d1d9fad868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:41.040949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-6009d72b-70ad-430a-884d-c3d1d9fad868 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:41.042293 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6009d72b-70ad-430a-884d-c3d1d9fad868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:41.051424 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1444/2847] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:41.055599 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f00bbe-a1e3-4b2c-910e-f670236a7d15 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:41.065602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f00bbe-a1e3-4b2c-910e-f670236a7d15 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:41.070154 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120d87-bd4a-410a-934c-b6b90ed4df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:41.070805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120d87-bd4a-410a-934c-b6b90ed4df13 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:41.071120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120d87-bd4a-410a-934c-b6b90ed4df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:41.071397 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d120d87-bd4a-410a-934c-b6b90ed4df13 admin admin] PATH_INFO: `/v3/domains` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:41.072114 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120d87-bd4a-410a-934c-b6b90ed4df13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92065) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 14:14:41.072425 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120d87-bd4a-410a-934c-b6b90ed4df13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:41.074008 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d120d87-bd4a-410a-934c-b6b90ed4df13 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:41.085802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1404/2848] 10.222.0.42 () {58 vars in 1152 bytes} [Fri May 27 14:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 14:14:41.090124 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d72b-70ad-430a-884d-c3d1d9fad868 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:41.099932 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009d72b-70ad-430a-884d-c3d1d9fad868 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:41.104674 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138fdc1-c53c-4c32-9a6f-a29d358d06f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:41.105360 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138fdc1-c53c-4c32-9a6f-a29d358d06f5 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:41.105643 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138fdc1-c53c-4c32-9a6f-a29d358d06f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:41.105915 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138fdc1-c53c-4c32-9a6f-a29d358d06f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:41.106603 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138fdc1-c53c-4c32-9a6f-a29d358d06f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:41.109443 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138fdc1-c53c-4c32-9a6f-a29d358d06f5 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:41.417958 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1445/2849] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:14:41 2022] POST /identity/v3/projects => generated 379 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:14:41.422407 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120d87-bd4a-410a-934c-b6b90ed4df13 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:41.434656 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d120d87-bd4a-410a-934c-b6b90ed4df13 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:41.508339 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42cdbf-13eb-4967-b6ab-110960358295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:41.508957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42cdbf-13eb-4967-b6ab-110960358295 admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:41.509312 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42cdbf-13eb-4967-b6ab-110960358295 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:41.509698 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42cdbf-13eb-4967-b6ab-110960358295 admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:41.510473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42cdbf-13eb-4967-b6ab-110960358295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:41.512773 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42cdbf-13eb-4967-b6ab-110960358295 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:41.885078 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1405/2850] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:14:41 2022] POST /identity/v3/users => generated 290 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:14:41.889173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138fdc1-c53c-4c32-9a6f-a29d358d06f5 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:41.900053 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138fdc1-c53c-4c32-9a6f-a29d358d06f5 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:41.905547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33206e26-4e23-43af-a05f-fe4bbfdb27e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:41.906335 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33206e26-4e23-43af-a05f-fe4bbfdb27e4 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:41.906628 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33206e26-4e23-43af-a05f-fe4bbfdb27e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:41.906890 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33206e26-4e23-43af-a05f-fe4bbfdb27e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:41.907654 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33206e26-4e23-43af-a05f-fe4bbfdb27e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:41.909299 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33206e26-4e23-43af-a05f-fe4bbfdb27e4 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:41.920772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1446/2851] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:14:41.932956 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42cdbf-13eb-4967-b6ab-110960358295 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:41.944147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42cdbf-13eb-4967-b6ab-110960358295 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:41.950155 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cd5c2-4b8f-45dc-a496-e180efd5afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:41.950873 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd5c2-4b8f-45dc-a496-e180efd5afee admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:41.951896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd5c2-4b8f-45dc-a496-e180efd5afee admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:41.951896 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd5c2-4b8f-45dc-a496-e180efd5afee admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:41.952259 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cd5c2-4b8f-45dc-a496-e180efd5afee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:41.953895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cd5c2-4b8f-45dc-a496-e180efd5afee admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:41.968256 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1406/2852] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:14:41.971801 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33206e26-4e23-43af-a05f-fe4bbfdb27e4 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:41.982811 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33206e26-4e23-43af-a05f-fe4bbfdb27e4 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:41.990172 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5810eca-d2ac-4e3d-953d-24d02cbd8bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:41.991229 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5810eca-d2ac-4e3d-953d-24d02cbd8bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:41.991584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5810eca-d2ac-4e3d-953d-24d02cbd8bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:41.991869 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5810eca-d2ac-4e3d-953d-24d02cbd8bd1 admin admin] PATH_INFO: `/v3/projects/86d3340824834147bc04e447ba9275f9/users/e890043baf574e4aaf50d1aed8a9f08a/roles/1067c35f1111496c983a6a7dec2a5ad9` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:42.010713 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5810eca-d2ac-4e3d-953d-24d02cbd8bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d3340824834147bc04e447ba9275f9, user_id=e890043baf574e4aaf50d1aed8a9f08a, role_id=1067c35f1111496c983a6a7dec2a5ad9)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:42.014390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5810eca-d2ac-4e3d-953d-24d02cbd8bd1 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:42.113911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1447/2853] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:14:41 2022] PUT /identity/v3/projects/86d3340824834147bc04e447ba9275f9/users/e890043baf574e4aaf50d1aed8a9f08a/roles/1067c35f1111496c983a6a7dec2a5ad9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:42.119566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceec24a-589c-4ffe-ae48-55eb7c852a20 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:42.119860 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceec24a-589c-4ffe-ae48-55eb7c852a20 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:42.120150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceec24a-589c-4ffe-ae48-55eb7c852a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:42.139904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-aceec24a-589c-4ffe-ae48-55eb7c852a20 None None] MFA Rules not processed for user `4343916bc48d4b1596f21b7dfce5ddf4`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:42.141138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-aceec24a-589c-4ffe-ae48-55eb7c852a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:42.210161 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1407/2854] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:42.216163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5810eca-d2ac-4e3d-953d-24d02cbd8bd1 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:42.218539 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d5810eca-d2ac-4e3d-953d-24d02cbd8bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:42.321319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5810eca-d2ac-4e3d-953d-24d02cbd8bd1 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:42.325796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ae166-a7eb-4b0b-81cd-8285e9c2074e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:42.326673 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ae166-a7eb-4b0b-81cd-8285e9c2074e service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:42.328820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ae166-a7eb-4b0b-81cd-8285e9c2074e service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:42.328820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ae166-a7eb-4b0b-81cd-8285e9c2074e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:42.338567 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ae166-a7eb-4b0b-81cd-8285e9c2074e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:42.340532 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ae166-a7eb-4b0b-81cd-8285e9c2074e service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:42.357867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1448/2855] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:14:42.662419 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc38a2-bed8-4746-ae45-2b0fcd4e9a9f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:42.662708 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc38a2-bed8-4746-ae45-2b0fcd4e9a9f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:42.663003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc38a2-bed8-4746-ae45-2b0fcd4e9a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:42.698428 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-c7fc38a2-bed8-4746-ae45-2b0fcd4e9a9f None None] MFA Rules not processed for user `7c43c1a675ed4a3587e8bcbad0b95fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:42.701220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-c7fc38a2-bed8-4746-ae45-2b0fcd4e9a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:42.782935 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1408/2856] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:42.783892 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ae166-a7eb-4b0b-81cd-8285e9c2074e service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:42.785489 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-361ae166-a7eb-4b0b-81cd-8285e9c2074e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:42.799274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ae166-a7eb-4b0b-81cd-8285e9c2074e service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:42.803974 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2df2dd-d0a8-452f-8475-04daa322dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:42.804660 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2df2dd-d0a8-452f-8475-04daa322dcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:42.804966 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2df2dd-d0a8-452f-8475-04daa322dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:42.809376 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2df2dd-d0a8-452f-8475-04daa322dcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:42.809376 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2df2dd-d0a8-452f-8475-04daa322dcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:42.809376 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2df2dd-d0a8-452f-8475-04daa322dcf2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:42.887832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1449/2857] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:14:42 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 14:14:42.892699 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc38a2-bed8-4746-ae45-2b0fcd4e9a9f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:42.905118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc38a2-bed8-4746-ae45-2b0fcd4e9a9f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:42.971067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac4473-577a-4166-8973-3a28bff3b45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:42.971748 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4473-577a-4166-8973-3a28bff3b45a admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:42.971989 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4473-577a-4166-8973-3a28bff3b45a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:42.972275 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4473-577a-4166-8973-3a28bff3b45a admin admin] PATH_INFO: `/v3/users` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:42.972961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac4473-577a-4166-8973-3a28bff3b45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:42.974897 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac4473-577a-4166-8973-3a28bff3b45a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:43.073938 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1409/2858] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:14:42 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:14:43.078361 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2df2dd-d0a8-452f-8475-04daa322dcf2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:43.089554 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2df2dd-d0a8-452f-8475-04daa322dcf2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:43.094688 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2723-c676-4ca0-a346-f28d9700c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:43.095407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2723-c676-4ca0-a346-f28d9700c4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:43.095690 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2723-c676-4ca0-a346-f28d9700c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:43.095979 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2723-c676-4ca0-a346-f28d9700c4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:43.096681 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2723-c676-4ca0-a346-f28d9700c4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:43.098301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2723-c676-4ca0-a346-f28d9700c4e8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:43.111522 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1450/2859] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:14:43.115743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac4473-577a-4166-8973-3a28bff3b45a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:43.129268 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac4473-577a-4166-8973-3a28bff3b45a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:43.137556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e24d3-bbe9-4442-870d-a71b7058cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:43.138556 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e24d3-bbe9-4442-870d-a71b7058cb88 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:43.138881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e24d3-bbe9-4442-870d-a71b7058cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:43.139220 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e24d3-bbe9-4442-870d-a71b7058cb88 admin admin] PATH_INFO: `/v3/projects/e5d0587b06504db0a27baa9a77d7ca51/users/0b6a34f7e58341ceb638bd5d5b7c451d/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:43.155056 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e24d3-bbe9-4442-870d-a71b7058cb88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d0587b06504db0a27baa9a77d7ca51, user_id=0b6a34f7e58341ceb638bd5d5b7c451d, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:43.157805 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e24d3-bbe9-4442-870d-a71b7058cb88 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:43.296662 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1410/2860] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:14:43 2022] PUT /identity/v3/projects/e5d0587b06504db0a27baa9a77d7ca51/users/0b6a34f7e58341ceb638bd5d5b7c451d/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:43.300798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2723-c676-4ca0-a346-f28d9700c4e8 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:43.306099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:43.312205 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2723-c676-4ca0-a346-f28d9700c4e8 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:43.375122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ef5ba-7737-48ef-8a78-01001d3911c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:43.375122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ef5ba-7737-48ef-8a78-01001d3911c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:43.375122 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ef5ba-7737-48ef-8a78-01001d3911c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:43.376449 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ef5ba-7737-48ef-8a78-01001d3911c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:43.377305 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ef5ba-7737-48ef-8a78-01001d3911c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:43.379830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ef5ba-7737-48ef-8a78-01001d3911c8 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:43.392873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1451/2861] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 14:14:43.396958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e24d3-bbe9-4442-870d-a71b7058cb88 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:43.408302 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e24d3-bbe9-4442-870d-a71b7058cb88 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:43.414961 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134052e3-e1df-46a9-9f6c-778cf5f54b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:43.416147 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134052e3-e1df-46a9-9f6c-778cf5f54b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:43.416532 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134052e3-e1df-46a9-9f6c-778cf5f54b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:43.416881 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134052e3-e1df-46a9-9f6c-778cf5f54b95 admin admin] PATH_INFO: `/v3/projects/e5d0587b06504db0a27baa9a77d7ca51/users/0b6a34f7e58341ceb638bd5d5b7c451d/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:43.419083 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134052e3-e1df-46a9-9f6c-778cf5f54b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d0587b06504db0a27baa9a77d7ca51, user_id=0b6a34f7e58341ceb638bd5d5b7c451d, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:43.421898 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134052e3-e1df-46a9-9f6c-778cf5f54b95 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:43.432761 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1411/2862] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:14:43 2022] PUT /identity/v3/projects/e5d0587b06504db0a27baa9a77d7ca51/users/0b6a34f7e58341ceb638bd5d5b7c451d/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:43.469082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:49.400072 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9405e5-2e17-46d6-b5d6-4d0ddd3d44ca None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:49.400561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9405e5-2e17-46d6-b5d6-4d0ddd3d44ca None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:49.400665 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9405e5-2e17-46d6-b5d6-4d0ddd3d44ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:49.437062 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-6d9405e5-2e17-46d6-b5d6-4d0ddd3d44ca None None] MFA Rules not processed for user `e890043baf574e4aaf50d1aed8a9f08a`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:49.438279 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-6d9405e5-2e17-46d6-b5d6-4d0ddd3d44ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:49.522377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1452/2863] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:49.523553 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134052e3-e1df-46a9-9f6c-778cf5f54b95 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:49.629295 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134052e3-e1df-46a9-9f6c-778cf5f54b95 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:49.635554 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e14a8-5ed2-428c-834f-6affa6b8c93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:49.639092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e14a8-5ed2-428c-834f-6affa6b8c93e admin admin] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:49.639092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e14a8-5ed2-428c-834f-6affa6b8c93e admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:49.639092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e14a8-5ed2-428c-834f-6affa6b8c93e admin admin] PATH_INFO: `/v3/projects` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:49.639092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e14a8-5ed2-428c-834f-6affa6b8c93e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:49.640911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e14a8-5ed2-428c-834f-6affa6b8c93e admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:49.679004 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:49.813855 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1412/2864] 10.222.0.42 () {60 vars in 1152 bytes} [Fri May 27 14:14:49 2022] POST /identity/v3/projects => generated 379 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:14:49.817826 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9405e5-2e17-46d6-b5d6-4d0ddd3d44ca None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:49.834418 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9405e5-2e17-46d6-b5d6-4d0ddd3d44ca None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:49.934804 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4a263-6518-41a9-a934-cbbb618eb520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:49.935911 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4a263-6518-41a9-a934-cbbb618eb520 admin admin] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:49.936199 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4a263-6518-41a9-a934-cbbb618eb520 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:49.936503 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4a263-6518-41a9-a934-cbbb618eb520 admin admin] PATH_INFO: `/v3/users` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:49.937658 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4a263-6518-41a9-a934-cbbb618eb520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:49.941590 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4a263-6518-41a9-a934-cbbb618eb520 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:50.074390 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1453/2865] 10.222.0.42 () {60 vars in 1143 bytes} [Fri May 27 14:14:49 2022] POST /identity/v3/users => generated 296 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 14:14:50.077829 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e14a8-5ed2-428c-834f-6affa6b8c93e admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:50.089707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e14a8-5ed2-428c-834f-6affa6b8c93e admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:50.097293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd216-7bca-4eaa-b40f-cb6857538507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:50.097981 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd216-7bca-4eaa-b40f-cb6857538507 admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:50.098279 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd216-7bca-4eaa-b40f-cb6857538507 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:50.098568 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd216-7bca-4eaa-b40f-cb6857538507 admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:50.099560 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bd216-7bca-4eaa-b40f-cb6857538507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:50.101218 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bd216-7bca-4eaa-b40f-cb6857538507 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:50.114722 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1413/2866] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:14:50.126949 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4a263-6518-41a9-a934-cbbb618eb520 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:50.137956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4a263-6518-41a9-a934-cbbb618eb520 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:50.145264 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94175210-a7a0-42c5-b569-cb7355515717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:50.146250 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94175210-a7a0-42c5-b569-cb7355515717 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:50.146541 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94175210-a7a0-42c5-b569-cb7355515717 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:50.146827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94175210-a7a0-42c5-b569-cb7355515717 admin admin] PATH_INFO: `/v3/projects/38c2be6161154fa8a7c03c62fa13ab19/users/54b1dac98dae49f3ab1f47e8265b46af/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:50.164809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94175210-a7a0-42c5-b569-cb7355515717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c2be6161154fa8a7c03c62fa13ab19, user_id=54b1dac98dae49f3ab1f47e8265b46af, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:50.165796 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94175210-a7a0-42c5-b569-cb7355515717 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:50.168416 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:50.366273 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1454/2867] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:14:50 2022] PUT /identity/v3/projects/38c2be6161154fa8a7c03c62fa13ab19/users/54b1dac98dae49f3ab1f47e8265b46af/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:50.370565 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd216-7bca-4eaa-b40f-cb6857538507 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:50.386507 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd216-7bca-4eaa-b40f-cb6857538507 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:50.485573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8fe3a-aec2-414e-9c57-3095a1c14f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:50.486364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8fe3a-aec2-414e-9c57-3095a1c14f0c admin admin] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:50.486653 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8fe3a-aec2-414e-9c57-3095a1c14f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:50.486944 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8fe3a-aec2-414e-9c57-3095a1c14f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:50.487792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8fe3a-aec2-414e-9c57-3095a1c14f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:50.489673 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8fe3a-aec2-414e-9c57-3095a1c14f0c admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:50.519018 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1414/2868] 10.222.0.42 () {58 vars in 1121 bytes} [Fri May 27 14:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 14:14:50.519183 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94175210-a7a0-42c5-b569-cb7355515717 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:50.539620 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94175210-a7a0-42c5-b569-cb7355515717 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:50.548383 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aa300-bc81-4f9a-bdd7-2dc162a5b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:50.549595 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa300-bc81-4f9a-bdd7-2dc162a5b347 admin admin] REQUEST_METHOD: `PUT` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:50.549879 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa300-bc81-4f9a-bdd7-2dc162a5b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:50.550163 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa300-bc81-4f9a-bdd7-2dc162a5b347 admin admin] PATH_INFO: `/v3/projects/38c2be6161154fa8a7c03c62fa13ab19/users/54b1dac98dae49f3ab1f47e8265b46af/roles/3951cc86a51d416fafc5676d456e79ce` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:50.552317 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aa300-bc81-4f9a-bdd7-2dc162a5b347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c2be6161154fa8a7c03c62fa13ab19, user_id=54b1dac98dae49f3ab1f47e8265b46af, role_id=3951cc86a51d416fafc5676d456e79ce)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:50.555276 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aa300-bc81-4f9a-bdd7-2dc162a5b347 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:50.570004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1455/2869] 10.222.0.42 () {60 vars in 1482 bytes} [Fri May 27 14:14:50 2022] PUT /identity/v3/projects/38c2be6161154fa8a7c03c62fa13ab19/users/54b1dac98dae49f3ab1f47e8265b46af/roles/3951cc86a51d416fafc5676d456e79ce => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:14:50.993948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0b5c-8df2-40ab-bbb7-5cce9aecb77a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:50.994450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0b5c-8df2-40ab-bbb7-5cce9aecb77a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:50.994572 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd0b5c-8df2-40ab-bbb7-5cce9aecb77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:51.027959 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-55fd0b5c-8df2-40ab-bbb7-5cce9aecb77a None None] MFA Rules not processed for user `0b6a34f7e58341ceb638bd5d5b7c451d`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:51.029891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-55fd0b5c-8df2-40ab-bbb7-5cce9aecb77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:51.117173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1415/2870] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:51.129103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aa300-bc81-4f9a-bdd7-2dc162a5b347 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:51.130867 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-177aa300-bc81-4f9a-bdd7-2dc162a5b347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:51.187976 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aa300-bc81-4f9a-bdd7-2dc162a5b347 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:51.191881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fba5a-b991-4914-834b-a01947c3df5b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb36541c7ba418a843e5ecbb1f1e337', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:51.192534 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fba5a-b991-4914-834b-a01947c3df5b service glance] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:51.192919 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fba5a-b991-4914-834b-a01947c3df5b service glance] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:51.193314 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fba5a-b991-4914-834b-a01947c3df5b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:51.258751 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fba5a-b991-4914-834b-a01947c3df5b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:51.260326 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fba5a-b991-4914-834b-a01947c3df5b service glance] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:51.270453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1456/2871] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:14:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:14:51.583605 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a002-5818-48c3-8807-1c4f42dd5db0 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:51.583952 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a002-5818-48c3-8807-1c4f42dd5db0 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:51.584285 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5a002-5818-48c3-8807-1c4f42dd5db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:51.604129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-7ca5a002-5818-48c3-8807-1c4f42dd5db0 None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:51.605356 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-7ca5a002-5818-48c3-8807-1c4f42dd5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:51.661745 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1416/2872] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:14:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:51.674582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fba5a-b991-4914-834b-a01947c3df5b service glance] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:51.675584 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-d23fba5a-b991-4914-834b-a01947c3df5b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:51.749803 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fba5a-b991-4914-834b-a01947c3df5b service glance] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:51.755301 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9f46e-6cf3-4dfc-8083-1e33130d5ebe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:51.755973 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9f46e-6cf3-4dfc-8083-1e33130d5ebe service swift] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:51.756259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9f46e-6cf3-4dfc-8083-1e33130d5ebe service swift] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:51.756551 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9f46e-6cf3-4dfc-8083-1e33130d5ebe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:51.767860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9f46e-6cf3-4dfc-8083-1e33130d5ebe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:51.769450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9f46e-6cf3-4dfc-8083-1e33130d5ebe service swift] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:51.778942 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1457/2873] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:14:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:14:58.141206 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c391a98-6fa9-4c2e-a21f-ab03d85a8725 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:58.143690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c391a98-6fa9-4c2e-a21f-ab03d85a8725 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:58.143690 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c391a98-6fa9-4c2e-a21f-ab03d85a8725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:58.171191 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:58.182583 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-4c391a98-6fa9-4c2e-a21f-ab03d85a8725 None None] MFA Rules not processed for user `54b1dac98dae49f3ab1f47e8265b46af`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:14:58.184335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-4c391a98-6fa9-4c2e-a21f-ab03d85a8725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:58.303082 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1417/2874] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:14:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:14:58.321094 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9f46e-6cf3-4dfc-8083-1e33130d5ebe service swift] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:14:58.323150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f1f9f46e-6cf3-4dfc-8083-1e33130d5ebe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:14:58.364015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:14:58.423441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9f46e-6cf3-4dfc-8083-1e33130d5ebe service swift] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:14:58.431245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907896a-ac2f-48bb-baeb-24ee2713da71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:14:58.432125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907896a-ac2f-48bb-baeb-24ee2713da71 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:14:58.432568 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907896a-ac2f-48bb-baeb-24ee2713da71 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:14:58.433479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907896a-ac2f-48bb-baeb-24ee2713da71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:14:58.556790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907896a-ac2f-48bb-baeb-24ee2713da71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:14:58.558506 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907896a-ac2f-48bb-baeb-24ee2713da71 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:14:58.589331 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1458/2875] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:14:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:15:06.049366 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d179388-518d-4fc7-b786-15f64111b20b None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:15:06.050246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d179388-518d-4fc7-b786-15f64111b20b None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:15:06.050525 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d179388-518d-4fc7-b786-15f64111b20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:15:06.070160 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-9d179388-518d-4fc7-b786-15f64111b20b None None] MFA Rules not processed for user `7c43c1a675ed4a3587e8bcbad0b95fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:15:06.071450 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9d179388-518d-4fc7-b786-15f64111b20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:15:06.078802 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1418/2876] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:15:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:15:08.888954 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907896a-ac2f-48bb-baeb-24ee2713da71 service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:15:08.907226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-9907896a-ac2f-48bb-baeb-24ee2713da71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:15:08.966924 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907896a-ac2f-48bb-baeb-24ee2713da71 service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:15:08.972451 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb104f1b-97b4-48f7-bf45-e1e77986112d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:15:08.973099 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb104f1b-97b4-48f7-bf45-e1e77986112d service placement] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:15:08.974167 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb104f1b-97b4-48f7-bf45-e1e77986112d service placement] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:15:08.974527 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb104f1b-97b4-48f7-bf45-e1e77986112d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:15:08.976599 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-fb104f1b-97b4-48f7-bf45-e1e77986112d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:15:08.990169 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb104f1b-97b4-48f7-bf45-e1e77986112d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:15:08.991848 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb104f1b-97b4-48f7-bf45-e1e77986112d service placement] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:15:09.002897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1459/2877] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:15:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:15:10.878769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625ef7f-a797-489d-ac1c-313f48530a20 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:15:10.879268 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625ef7f-a797-489d-ac1c-313f48530a20 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:15:10.879366 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625ef7f-a797-489d-ac1c-313f48530a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:15:10.931736 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-5625ef7f-a797-489d-ac1c-313f48530a20 None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:15:10.932936 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5625ef7f-a797-489d-ac1c-313f48530a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:15:10.950262 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1419/2878] 10.222.0.42 () {58 vars in 1009 bytes} [Fri May 27 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:15:10.963065 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb104f1b-97b4-48f7-bf45-e1e77986112d service placement] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:15:10.984820 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb104f1b-97b4-48f7-bf45-e1e77986112d service placement] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:15:10.990339 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f282d2-00e3-4602-b4c1-6b9c79140e0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:15:10.991364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f282d2-00e3-4602-b4c1-6b9c79140e0e service swift] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:15:10.991745 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f282d2-00e3-4602-b4c1-6b9c79140e0e service swift] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:15:10.992086 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f282d2-00e3-4602-b4c1-6b9c79140e0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:15:11.002450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f282d2-00e3-4602-b4c1-6b9c79140e0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:15:11.004050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f282d2-00e3-4602-b4c1-6b9c79140e0e service swift] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:15:11.012313 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1460/2879] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:15:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:15:20.947069 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=51 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:15:21.008886 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=87 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:15:27.850390 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d8bb-9d66-4da0-a31e-1eff9750c0f2 None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:15:27.850948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d8bb-9d66-4da0-a31e-1eff9750c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:15:27.850948 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4d8bb-9d66-4da0-a31e-1eff9750c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:15:27.868769 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-50c4d8bb-9d66-4da0-a31e-1eff9750c0f2 None None] MFA Rules not processed for user `e890043baf574e4aaf50d1aed8a9f08a`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:15:27.870065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-50c4d8bb-9d66-4da0-a31e-1eff9750c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:15:27.877958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1420/2880] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:15:37.863478 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=3 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:15:48.636406 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f282d2-00e3-4602-b4c1-6b9c79140e0e service swift] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:15:48.704701 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f282d2-00e3-4602-b4c1-6b9c79140e0e service swift] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:15:48.708407 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f245-26a9-43b1-a6b9-1a265ee5a2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:15:48.709063 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f245-26a9-43b1-a6b9-1a265ee5a2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:15:48.710040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f245-26a9-43b1-a6b9-1a265ee5a2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:15:48.710040 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196f245-26a9-43b1-a6b9-1a265ee5a2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:15:48.720216 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196f245-26a9-43b1-a6b9-1a265ee5a2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:15:48.721829 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196f245-26a9-43b1-a6b9-1a265ee5a2b3 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:15:48.731542 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1461/2881] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:15:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:15:51.519792 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4d8bb-9d66-4da0-a31e-1eff9750c0f2 None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:15:51.523893 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-50c4d8bb-9d66-4da0-a31e-1eff9750c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:15:51.536455 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4d8bb-9d66-4da0-a31e-1eff9750c0f2 None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:15:51.540129 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d4a5e-af07-43fc-83af-ddb59cff2050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:15:51.540783 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4a5e-af07-43fc-83af-ddb59cff2050 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:15:51.541065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4a5e-af07-43fc-83af-ddb59cff2050 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:15:51.541342 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4a5e-af07-43fc-83af-ddb59cff2050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:15:51.551120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d4a5e-af07-43fc-83af-ddb59cff2050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:15:51.552573 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d4a5e-af07-43fc-83af-ddb59cff2050 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:15:51.563335 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1421/2882] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:15:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:15:54.152481 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f245-26a9-43b1-a6b9-1a265ee5a2b3 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:15:54.153904 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f196f245-26a9-43b1-a6b9-1a265ee5a2b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:15:54.170114 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196f245-26a9-43b1-a6b9-1a265ee5a2b3 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:15:54.176786 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509e5e3-c39a-48c5-a4d4-f683b37ff670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:15:54.177442 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509e5e3-c39a-48c5-a4d4-f683b37ff670 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:15:54.177724 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509e5e3-c39a-48c5-a4d4-f683b37ff670 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:15:54.177993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509e5e3-c39a-48c5-a4d4-f683b37ff670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:15:54.179930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c509e5e3-c39a-48c5-a4d4-f683b37ff670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:15:54.195004 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509e5e3-c39a-48c5-a4d4-f683b37ff670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:15:54.196809 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509e5e3-c39a-48c5-a4d4-f683b37ff670 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:15:54.208930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1462/2883] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:15:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:16:01.558149 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=6 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:16:04.203862 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=32 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:16:28.813609 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d4a5e-af07-43fc-83af-ddb59cff2050 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:16:28.822871 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d4a5e-af07-43fc-83af-ddb59cff2050 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:16:28.826487 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee94b1d-c7fe-4508-83d0-00ac7e0e001b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:16:28.827150 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee94b1d-c7fe-4508-83d0-00ac7e0e001b service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:16:28.827433 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee94b1d-c7fe-4508-83d0-00ac7e0e001b service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:16:28.827709 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee94b1d-c7fe-4508-83d0-00ac7e0e001b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:16:28.829567 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-2ee94b1d-c7fe-4508-83d0-00ac7e0e001b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:16:28.843964 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee94b1d-c7fe-4508-83d0-00ac7e0e001b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:16:28.845641 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee94b1d-c7fe-4508-83d0-00ac7e0e001b service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:16:28.856684 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1422/2884] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:16:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:16:30.029913 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509e5e3-c39a-48c5-a4d4-f683b37ff670 service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:16:30.039564 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509e5e3-c39a-48c5-a4d4-f683b37ff670 service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:16:30.043106 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40fdf-90fa-47e8-a93b-9d31642c450e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:16:30.043739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40fdf-90fa-47e8-a93b-9d31642c450e service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:16:30.044019 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40fdf-90fa-47e8-a93b-9d31642c450e service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:16:30.044289 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db40fdf-90fa-47e8-a93b-9d31642c450e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:16:30.046014 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1db40fdf-90fa-47e8-a93b-9d31642c450e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:16:30.059252 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db40fdf-90fa-47e8-a93b-9d31642c450e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:16:30.060655 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db40fdf-90fa-47e8-a93b-9d31642c450e service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:16:30.071984 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1463/2885] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:16:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:16:38.851762 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=6 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:16:40.066611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=6 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:16:43.142250 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee94b1d-c7fe-4508-83d0-00ac7e0e001b service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:16:43.151260 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee94b1d-c7fe-4508-83d0-00ac7e0e001b service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:16:43.154778 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8f255-6558-4b3b-a9c4-f0544a9b437e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:16:43.155439 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f255-6558-4b3b-a9c4-f0544a9b437e service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:16:43.155722 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f255-6558-4b3b-a9c4-f0544a9b437e service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:16:43.156079 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f255-6558-4b3b-a9c4-f0544a9b437e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:16:43.157821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d1d8f255-6558-4b3b-a9c4-f0544a9b437e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:16:43.167315 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8f255-6558-4b3b-a9c4-f0544a9b437e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:16:43.168728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8f255-6558-4b3b-a9c4-f0544a9b437e service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:16:43.177287 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1423/2886] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:16:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:16:44.489773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40fdf-90fa-47e8-a93b-9d31642c450e service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:16:44.498651 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db40fdf-90fa-47e8-a93b-9d31642c450e service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:16:44.502364 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb64576-b2c8-490c-a159-a1f6fb3e4a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:16:44.503020 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb64576-b2c8-490c-a159-a1f6fb3e4a95 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:16:44.503302 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb64576-b2c8-490c-a159-a1f6fb3e4a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:16:44.503574 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb64576-b2c8-490c-a159-a1f6fb3e4a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:16:44.506462 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-7fb64576-b2c8-490c-a159-a1f6fb3e4a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:16:44.517460 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb64576-b2c8-490c-a159-a1f6fb3e4a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:16:44.518798 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb64576-b2c8-490c-a159-a1f6fb3e4a95 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:16:44.528088 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1464/2887] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:16:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:16:44.631115 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8f255-6558-4b3b-a9c4-f0544a9b437e service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:16:44.639752 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8f255-6558-4b3b-a9c4-f0544a9b437e service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:16:44.643415 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881f255-28c4-4a3f-ac53-9d9f6f4f1648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:16:44.648135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881f255-28c4-4a3f-ac53-9d9f6f4f1648 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:16:44.648135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881f255-28c4-4a3f-ac53-9d9f6f4f1648 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:16:44.648135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881f255-28c4-4a3f-ac53-9d9f6f4f1648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:16:44.648135 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a881f255-28c4-4a3f-ac53-9d9f6f4f1648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:16:44.660721 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881f255-28c4-4a3f-ac53-9d9f6f4f1648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:16:44.662337 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881f255-28c4-4a3f-ac53-9d9f6f4f1648 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:16:44.674767 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1424/2888] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:16:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:16:54.524427 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=6 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:16:54.668393 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=12 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:17:11.362042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb64576-b2c8-490c-a159-a1f6fb3e4a95 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:17:11.370856 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb64576-b2c8-490c-a159-a1f6fb3e4a95 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:17:11.374588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c203d-e3f1-41f0-9cca-4c5d17dfeb02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:17:11.375259 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c203d-e3f1-41f0-9cca-4c5d17dfeb02 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:17:11.375540 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c203d-e3f1-41f0-9cca-4c5d17dfeb02 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:17:11.375812 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c203d-e3f1-41f0-9cca-4c5d17dfeb02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:17:11.377556 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ec1c203d-e3f1-41f0-9cca-4c5d17dfeb02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:17:11.387482 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c203d-e3f1-41f0-9cca-4c5d17dfeb02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:17:11.388956 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c203d-e3f1-41f0-9cca-4c5d17dfeb02 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:17:11.396881 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1465/2889] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:17:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:17:21.393354 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=6 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:18:12.010743 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881f255-28c4-4a3f-ac53-9d9f6f4f1648 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:12.024029 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881f255-28c4-4a3f-ac53-9d9f6f4f1648 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:12.027983 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c67b5-8954-4b15-9cb1-1487f6de2c41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:12.028626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c67b5-8954-4b15-9cb1-1487f6de2c41 service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:12.028909 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c67b5-8954-4b15-9cb1-1487f6de2c41 service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:12.029186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c67b5-8954-4b15-9cb1-1487f6de2c41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:12.031071 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-ee5c67b5-8954-4b15-9cb1-1487f6de2c41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:12.044158 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c67b5-8954-4b15-9cb1-1487f6de2c41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:12.046048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c67b5-8954-4b15-9cb1-1487f6de2c41 service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:12.060809 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1425/2890] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:18:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:18:13.905935 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e4411-efdb-4909-af7a-8c5edcaa93b3 None None] REQUEST_METHOD: `POST` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:13.906468 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e4411-efdb-4909-af7a-8c5edcaa93b3 None None] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:13.906585 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e4411-efdb-4909-af7a-8c5edcaa93b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:13.924395 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.auth.core [None req-598e4411-efdb-4909-af7a-8c5edcaa93b3 None None] MFA Rules not processed for user `e890043baf574e4aaf50d1aed8a9f08a`. Rule list: `[]` (Enabled: `True`). {{(pid=92064) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:18:13.925941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-598e4411-efdb-4909-af7a-8c5edcaa93b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:13.933150 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1466/2891] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:18:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:18:22.055479 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=6 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:18:23.919559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=3 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:18:26.423821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941b2b9-d21c-4011-ae44-29a1d28ddd7f None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:26.423821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941b2b9-d21c-4011-ae44-29a1d28ddd7f None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:26.423821 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941b2b9-d21c-4011-ae44-29a1d28ddd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:26.441591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-9941b2b9-d21c-4011-ae44-29a1d28ddd7f None None] MFA Rules not processed for user `604a6139cec24af6a40c5eee3f197b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:18:26.442807 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9941b2b9-d21c-4011-ae44-29a1d28ddd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:26.450051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1426/2892] 10.222.0.42 () {58 vars in 967 bytes} [Fri May 27 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:18:26.503941 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e4411-efdb-4909-af7a-8c5edcaa93b3 None None] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:26.515996 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e4411-efdb-4909-af7a-8c5edcaa93b3 None None] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:26.521164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63109daf-91bc-4657-9931-72ae4d524343 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ea258578544e5c8f05b751d31e0f34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:26.521827 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63109daf-91bc-4657-9931-72ae4d524343 service swift] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:26.522112 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63109daf-91bc-4657-9931-72ae4d524343 service swift] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:26.522389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63109daf-91bc-4657-9931-72ae4d524343 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:26.531048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63109daf-91bc-4657-9931-72ae4d524343 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:26.532624 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63109daf-91bc-4657-9931-72ae4d524343 service swift] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:26.541691 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1467/2893] 10.222.0.42 () {60 vars in 1384 bytes} [Fri May 27 14:18:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 14:18:31.273884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941b2b9-d21c-4011-ae44-29a1d28ddd7f None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:31.290772 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941b2b9-d21c-4011-ae44-29a1d28ddd7f None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:31.296104 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372421c-8ba4-49df-a72b-f877ce0b276f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:31.297060 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372421c-8ba4-49df-a72b-f877ce0b276f service placement] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:31.299030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372421c-8ba4-49df-a72b-f877ce0b276f service placement] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:31.299030 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372421c-8ba4-49df-a72b-f877ce0b276f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:31.299957 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5372421c-8ba4-49df-a72b-f877ce0b276f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:31.318836 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372421c-8ba4-49df-a72b-f877ce0b276f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:31.320464 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372421c-8ba4-49df-a72b-f877ce0b276f service placement] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:31.332038 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1427/2894] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:18:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:18:35.167444 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63109daf-91bc-4657-9931-72ae4d524343 service swift] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:35.179731 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63109daf-91bc-4657-9931-72ae4d524343 service swift] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:35.184761 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7d050-ddbd-44b3-a360-6d7b172393c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:35.185611 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7d050-ddbd-44b3-a360-6d7b172393c5 service placement] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:35.195841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7d050-ddbd-44b3-a360-6d7b172393c5 service placement] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:35.195841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7d050-ddbd-44b3-a360-6d7b172393c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:35.195841 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-a2a7d050-ddbd-44b3-a360-6d7b172393c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:35.200369 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7d050-ddbd-44b3-a360-6d7b172393c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:35.202089 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7d050-ddbd-44b3-a360-6d7b172393c5 service placement] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:35.213499 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1468/2895] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:18:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:18:35.315124 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372421c-8ba4-49df-a72b-f877ce0b276f service placement] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:35.380768 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372421c-8ba4-49df-a72b-f877ce0b276f service placement] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:35.385503 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:35.386373 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:35.386706 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:35.387012 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] PATH_INFO: `/v3/users/7c43c1a675ed4a3587e8bcbad0b95fc9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:35.388203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c43c1a675ed4a3587e8bcbad0b95fc9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:35.390192 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:35.565867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c43c1a675ed4a3587e8bcbad0b95fc9'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:35.566473 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c43c1a675ed4a3587e8bcbad0b95fc9'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:35.567144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c43c1a675ed4a3587e8bcbad0b95fc9'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:35.573962 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c43c1a675ed4a3587e8bcbad0b95fc9'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:35.586347 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c43c1a675ed4a3587e8bcbad0b95fc9'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:35.659624 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1428/2896] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:18:35 2022] DELETE /identity/v3/users/7c43c1a675ed4a3587e8bcbad0b95fc9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:18:35.905715 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7d050-ddbd-44b3-a360-6d7b172393c5 service placement] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:35.917116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7d050-ddbd-44b3-a360-6d7b172393c5 service placement] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:35.977543 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:35.978659 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:35.978943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:35.979261 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] PATH_INFO: `/v3/projects/3db847e7be094f10a4ff9bd34960b6cc` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:35.980450 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db847e7be094f10a4ff9bd34960b6cc)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:35.982357 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:36.111689 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db847e7be094f10a4ff9bd34960b6cc', 'request_id': 'req-330934c1-11aa-45cc-9971-2ab5019f0107'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.117588 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db847e7be094f10a4ff9bd34960b6cc', 'request_id': 'req-330934c1-11aa-45cc-9971-2ab5019f0107'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.126586 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db847e7be094f10a4ff9bd34960b6cc', 'request_id': 'req-330934c1-11aa-45cc-9971-2ab5019f0107'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.213547 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] The token cache is being invalidate because project 3db847e7be094f10a4ff9bd34960b6cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:18:36.214232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.214743 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.216367 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1469/2897] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:18:35 2022] DELETE /identity/v3/projects/3db847e7be094f10a4ff9bd34960b6cc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:18:36.220602 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:36.223970 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:36.237497 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e807b48-91fd-483e-b703-b33925f70cd6 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:36.296283 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:36.297157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:36.297441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:36.297719 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] PATH_INFO: `/v3/users/0b6a34f7e58341ceb638bd5d5b7c451d` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:36.298884 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6a34f7e58341ceb638bd5d5b7c451d)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:36.301514 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:36.303050 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:18:36.468041 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6a34f7e58341ceb638bd5d5b7c451d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.468832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6a34f7e58341ceb638bd5d5b7c451d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.469526 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6a34f7e58341ceb638bd5d5b7c451d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.477660 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6a34f7e58341ceb638bd5d5b7c451d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.491383 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6a34f7e58341ceb638bd5d5b7c451d'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.575293 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1429/2898] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:18:36 2022] DELETE /identity/v3/users/0b6a34f7e58341ceb638bd5d5b7c451d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:18:36.821485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:36.823999 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:36.837206 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330934c1-11aa-45cc-9971-2ab5019f0107 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:36.896351 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:36.897212 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:36.897496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:36.897772 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] PATH_INFO: `/v3/projects/e5d0587b06504db0a27baa9a77d7ca51` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:36.898946 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d0587b06504db0a27baa9a77d7ca51)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:36.900873 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:36.907042 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:18:36.994697 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d0587b06504db0a27baa9a77d7ca51', 'request_id': 'req-ff6ae721-70b3-4708-8aac-7b40596a05f2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:36.999943 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d0587b06504db0a27baa9a77d7ca51', 'request_id': 'req-ff6ae721-70b3-4708-8aac-7b40596a05f2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:37.007164 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d0587b06504db0a27baa9a77d7ca51', 'request_id': 'req-ff6ae721-70b3-4708-8aac-7b40596a05f2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:37.098845 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] The token cache is being invalidate because project e5d0587b06504db0a27baa9a77d7ca51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:18:37.099130 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:37.099696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:37.101251 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1470/2899] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:18:36 2022] DELETE /identity/v3/projects/e5d0587b06504db0a27baa9a77d7ca51 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:18:38.126414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:38.127978 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:38.193217 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caad8a-78ee-4e97-bc07-1f10d8d32394 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:38.243604 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6cd6e-3f9a-4c78-850f-96cca104d407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:38.243915 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6cd6e-3f9a-4c78-850f-96cca104d407 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:38.244203 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6cd6e-3f9a-4c78-850f-96cca104d407 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:38.244481 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6cd6e-3f9a-4c78-850f-96cca104d407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:38.246282 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d2e6cd6e-3f9a-4c78-850f-96cca104d407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:38.295536 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:18:38.306717 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6cd6e-3f9a-4c78-850f-96cca104d407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:38.308199 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6cd6e-3f9a-4c78-850f-96cca104d407 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:38.317844 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1430/2900] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:18:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:18:46.228274 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:46.229684 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:46.242485 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ae721-70b3-4708-8aac-7b40596a05f2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:46.246176 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aefc09-0730-441f-aa83-2d428355984f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:46.246839 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aefc09-0730-441f-aa83-2d428355984f service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:46.247363 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aefc09-0730-441f-aa83-2d428355984f service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:46.247648 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aefc09-0730-441f-aa83-2d428355984f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:46.249420 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-c3aefc09-0730-441f-aa83-2d428355984f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:46.312531 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aefc09-0730-441f-aa83-2d428355984f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:46.313964 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aefc09-0730-441f-aa83-2d428355984f service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:46.324156 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1471/2901] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:18:48.692398 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=5 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:18:53.929364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6cd6e-3f9a-4c78-850f-96cca104d407 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:53.930958 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-d2e6cd6e-3f9a-4c78-850f-96cca104d407 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:53.945742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6cd6e-3f9a-4c78-850f-96cca104d407 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:53.950681 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:53.955895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:53.955895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:53.955895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] PATH_INFO: `/v3/users/9bf4783f2e7b404bbc71a99f753f0303` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:53.955895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf4783f2e7b404bbc71a99f753f0303)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:53.955895 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:54.153377 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf4783f2e7b404bbc71a99f753f0303'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:54.153937 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf4783f2e7b404bbc71a99f753f0303'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:54.154566 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf4783f2e7b404bbc71a99f753f0303'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:54.162118 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf4783f2e7b404bbc71a99f753f0303'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:54.174052 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf4783f2e7b404bbc71a99f753f0303'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:54.263538 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1431/2902] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:18:53 2022] DELETE /identity/v3/users/9bf4783f2e7b404bbc71a99f753f0303 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:18:54.511245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aefc09-0730-441f-aa83-2d428355984f service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:54.522005 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aefc09-0730-441f-aa83-2d428355984f service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:54.588441 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:54.589409 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:54.589682 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:54.589983 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] PATH_INFO: `/v3/projects/283df31f708f4428a65991fa890e4481` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:54.591280 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=283df31f708f4428a65991fa890e4481)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:54.593236 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:54.716162 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:18:54.729436 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283df31f708f4428a65991fa890e4481', 'request_id': 'req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:54.735048 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283df31f708f4428a65991fa890e4481', 'request_id': 'req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:54.741601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283df31f708f4428a65991fa890e4481', 'request_id': 'req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:54.846036 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] The token cache is being invalidate because project 283df31f708f4428a65991fa890e4481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:18:54.846325 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:54.849103 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:54.850736 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1472/2903] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:18:54 2022] DELETE /identity/v3/projects/283df31f708f4428a65991fa890e4481 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:18:54.854750 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:54.856186 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:54.869701 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8fcea-f325-4beb-89f7-4e54f1a8b55a admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:54.928991 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:54.929864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:54.930434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:54.930434 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] PATH_INFO: `/v3/users/854568777d1849579f2f812c28842bb3` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:54.931614 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=854568777d1849579f2f812c28842bb3)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:54.933577 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:55.165101 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854568777d1849579f2f812c28842bb3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:55.165728 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854568777d1849579f2f812c28842bb3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:55.166333 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854568777d1849579f2f812c28842bb3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:55.173187 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854568777d1849579f2f812c28842bb3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:55.184785 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854568777d1849579f2f812c28842bb3'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:55.186441 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:18:55.328355 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1432/2904] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:18:54 2022] DELETE /identity/v3/users/854568777d1849579f2f812c28842bb3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:18:55.558681 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:18:55.560286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:18:55.574419 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c93ca-30a6-4b6f-84ca-e5ba4a4af2d2 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:18:55.632158 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:18:55.633127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:18:55.633412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:18:55.633687 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] PATH_INFO: `/v3/projects/22cb5a8bd98048c58c31f4aeb0409f7b` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:18:55.634850 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22cb5a8bd98048c58c31f4aeb0409f7b)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:18:55.636782 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:18:55.763334 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22cb5a8bd98048c58c31f4aeb0409f7b', 'request_id': 'req-499428df-a51b-433c-9c15-d47a6ae87381'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:55.769049 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22cb5a8bd98048c58c31f4aeb0409f7b', 'request_id': 'req-499428df-a51b-433c-9c15-d47a6ae87381'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:55.775790 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22cb5a8bd98048c58c31f4aeb0409f7b', 'request_id': 'req-499428df-a51b-433c-9c15-d47a6ae87381'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:55.853319 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] The token cache is being invalidate because project 22cb5a8bd98048c58c31f4aeb0409f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92064) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:18:55.853607 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:55.854308 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:18:55.855936 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1473/2905] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:18:55 2022] DELETE /identity/v3/projects/22cb5a8bd98048c58c31f4aeb0409f7b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:19:05.402878 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:19:05.850125 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:20:22.620677 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:20:22.622138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:20:22.693598 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea00443-bfae-4642-b0d6-67e4d2fb71fc admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:20:22.752759 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695edfe-0d60-4486-9775-536ef53b5a52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:20:22.753744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695edfe-0d60-4486-9775-536ef53b5a52 service placement] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:20:22.753744 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695edfe-0d60-4486-9775-536ef53b5a52 service placement] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:20:22.754003 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695edfe-0d60-4486-9775-536ef53b5a52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:20:22.755832 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-e695edfe-0d60-4486-9775-536ef53b5a52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:20:22.767839 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695edfe-0d60-4486-9775-536ef53b5a52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:20:22.769422 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695edfe-0d60-4486-9775-536ef53b5a52 service placement] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:20:22.780092 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1433/2906] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:20:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:20:32.775815 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=58 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:20:34.267988 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:20:34.269601 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:20:34.327920 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499428df-a51b-433c-9c15-d47a6ae87381 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:20:34.331529 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de7f9e-cf56-4c30-9c03-4dd99f98d981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e3e451167fc4984be9726430f436e40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:20:34.332173 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7f9e-cf56-4c30-9c03-4dd99f98d981 service cinder] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:20:34.332457 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7f9e-cf56-4c30-9c03-4dd99f98d981 service cinder] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:20:34.332739 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de7f9e-cf56-4c30-9c03-4dd99f98d981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:20:34.334523 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-61de7f9e-cf56-4c30-9c03-4dd99f98d981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:20:34.393400 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de7f9e-cf56-4c30-9c03-4dd99f98d981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:20:34.394832 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de7f9e-cf56-4c30-9c03-4dd99f98d981 service cinder] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:20:34.404221 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1474/2907] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:20:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:20:44.399575 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=48 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:20:47.079913 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78714ad7-3d91-4277-a1b7-8eaf19c6bd7a None None] REQUEST_METHOD: `POST` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:20:47.080426 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78714ad7-3d91-4277-a1b7-8eaf19c6bd7a None None] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:20:47.080531 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78714ad7-3d91-4277-a1b7-8eaf19c6bd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:20:47.099789 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.auth.core [None req-78714ad7-3d91-4277-a1b7-8eaf19c6bd7a None None] MFA Rules not processed for user `e890043baf574e4aaf50d1aed8a9f08a`. Rule list: `[]` (Enabled: `True`). {{(pid=92065) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 14:20:47.101231 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-78714ad7-3d91-4277-a1b7-8eaf19c6bd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:20:47.108721 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1434/2908] 10.222.0.42 () {58 vars in 957 bytes} [Fri May 27 14:20:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 14:20:47.422939 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de7f9e-cf56-4c30-9c03-4dd99f98d981 service cinder] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:20:47.424378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-61de7f9e-cf56-4c30-9c03-4dd99f98d981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:20:47.480057 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de7f9e-cf56-4c30-9c03-4dd99f98d981 service cinder] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:20:47.486084 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deead532-071e-40b1-8935-f21d14347bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:20:47.486672 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead532-071e-40b1-8935-f21d14347bbb service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:20:47.486950 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead532-071e-40b1-8935-f21d14347bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:20:47.487254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead532-071e-40b1-8935-f21d14347bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:20:47.489000 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-deead532-071e-40b1-8935-f21d14347bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:20:47.498653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deead532-071e-40b1-8935-f21d14347bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:20:47.500097 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deead532-071e-40b1-8935-f21d14347bbb service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:20:47.508440 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1475/2909] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:20:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:20:49.345601 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78714ad7-3d91-4277-a1b7-8eaf19c6bd7a None None] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:20:49.347051 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-78714ad7-3d91-4277-a1b7-8eaf19c6bd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:20:49.362272 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78714ad7-3d91-4277-a1b7-8eaf19c6bd7a None None] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:20:49.367138 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdaa7a-a690-40f9-9902-0e1ef8679b43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:20:49.367760 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdaa7a-a690-40f9-9902-0e1ef8679b43 service placement] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:20:49.368048 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdaa7a-a690-40f9-9902-0e1ef8679b43 service placement] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:20:49.368323 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdaa7a-a690-40f9-9902-0e1ef8679b43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:20:49.370021 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-11cdaa7a-a690-40f9-9902-0e1ef8679b43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:20:49.382068 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdaa7a-a690-40f9-9902-0e1ef8679b43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:20:49.383669 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdaa7a-a690-40f9-9902-0e1ef8679b43 service placement] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:20:49.395246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1435/2910] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:20:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:20:57.505050 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=26 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:20:59.389866 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=9 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:21:08.835378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deead532-071e-40b1-8935-f21d14347bbb service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:21:08.837226 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-deead532-071e-40b1-8935-f21d14347bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:21:08.928194 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deead532-071e-40b1-8935-f21d14347bbb service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:21:08.941582 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a077e5-21b8-4745-b560-6ff4347842b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:21:08.942263 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a077e5-21b8-4745-b560-6ff4347842b2 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:21:08.942558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a077e5-21b8-4745-b560-6ff4347842b2 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:21:08.943079 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a077e5-21b8-4745-b560-6ff4347842b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:21:08.952933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-91a077e5-21b8-4745-b560-6ff4347842b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:21:08.958696 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a077e5-21b8-4745-b560-6ff4347842b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:21:08.960396 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a077e5-21b8-4745-b560-6ff4347842b2 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:21:08.972572 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1476/2911] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:21:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:21:12.622401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdaa7a-a690-40f9-9902-0e1ef8679b43 service placement] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:21:12.623867 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-11cdaa7a-a690-40f9-9902-0e1ef8679b43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:21:12.635380 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdaa7a-a690-40f9-9902-0e1ef8679b43 service placement] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:21:12.638921 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f6968-5bdb-45a3-9535-65736c7e3022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:21:12.639591 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f6968-5bdb-45a3-9535-65736c7e3022 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:21:12.639877 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f6968-5bdb-45a3-9535-65736c7e3022 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:21:12.640156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f6968-5bdb-45a3-9535-65736c7e3022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:21:12.641864 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-cd3f6968-5bdb-45a3-9535-65736c7e3022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:21:12.706246 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f6968-5bdb-45a3-9535-65736c7e3022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:21:12.708214 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f6968-5bdb-45a3-9535-65736c7e3022 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:21:12.717757 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1436/2912] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:21:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:21:18.967132 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=34 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:21:22.713436 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=30 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:22:16.350012 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a077e5-21b8-4745-b560-6ff4347842b2 service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:22:16.359576 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a077e5-21b8-4745-b560-6ff4347842b2 service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:22:16.363933 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd4e07-adb4-4c31-ae11-a63e096ff759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:22:16.364563 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd4e07-adb4-4c31-ae11-a63e096ff759 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:22:16.364842 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd4e07-adb4-4c31-ae11-a63e096ff759 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:22:16.365115 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd4e07-adb4-4c31-ae11-a63e096ff759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:22:16.366831 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-f5fd4e07-adb4-4c31-ae11-a63e096ff759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:22:16.376224 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd4e07-adb4-4c31-ae11-a63e096ff759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:22:16.377930 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd4e07-adb4-4c31-ae11-a63e096ff759 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:22:16.386127 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1477/2913] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:22:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:22:26.382366 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=6 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:23:05.262438 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f6968-5bdb-45a3-9535-65736c7e3022 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:23:05.264075 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-cd3f6968-5bdb-45a3-9535-65736c7e3022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:23:05.342045 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f6968-5bdb-45a3-9535-65736c7e3022 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:23:05.347766 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dace61-9f7b-42b7-ace3-31f299c22b7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:23:05.348417 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dace61-9f7b-42b7-ace3-31f299c22b7f service nova] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:23:05.348700 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dace61-9f7b-42b7-ace3-31f299c22b7f service nova] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:23:05.348979 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dace61-9f7b-42b7-ace3-31f299c22b7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:23:05.350822 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a3dace61-9f7b-42b7-ace3-31f299c22b7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:23:05.364198 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dace61-9f7b-42b7-ace3-31f299c22b7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:23:05.365882 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dace61-9f7b-42b7-ace3-31f299c22b7f service nova] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:23:05.377173 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1437/2914] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:23:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:23:05.658993 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd4e07-adb4-4c31-ae11-a63e096ff759 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:23:05.698589 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd4e07-adb4-4c31-ae11-a63e096ff759 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:23:05.702488 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16c172-584b-4611-87a4-d47f90911790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:23:05.703312 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16c172-584b-4611-87a4-d47f90911790 service neutron] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:23:05.703594 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16c172-584b-4611-87a4-d47f90911790 service neutron] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:23:05.703871 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16c172-584b-4611-87a4-d47f90911790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:23:05.705778 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-8b16c172-584b-4611-87a4-d47f90911790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:23:05.720333 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16c172-584b-4611-87a4-d47f90911790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:23:05.721787 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16c172-584b-4611-87a4-d47f90911790 service neutron] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:23:05.734559 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1478/2915] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:23:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:23:06.919812 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dace61-9f7b-42b7-ace3-31f299c22b7f service nova] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:23:06.929678 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dace61-9f7b-42b7-ace3-31f299c22b7f service nova] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:23:06.933222 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5f17-2dd8-49e0-b6f5-8a8e5be0f828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:23:06.934559 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5f17-2dd8-49e0-b6f5-8a8e5be0f828 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:23:06.934837 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5f17-2dd8-49e0-b6f5-8a8e5be0f828 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:23:06.935144 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd5f17-2dd8-49e0-b6f5-8a8e5be0f828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:23:06.936891 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-a2dd5f17-2dd8-49e0-b6f5-8a8e5be0f828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:23:06.950157 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd5f17-2dd8-49e0-b6f5-8a8e5be0f828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:23:06.951626 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd5f17-2dd8-49e0-b6f5-8a8e5be0f828 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:23:06.962463 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1438/2916] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:23:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:23:15.728254 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=18 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:23:16.334711 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16c172-584b-4611-87a4-d47f90911790 service neutron] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:23:16.345887 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16c172-584b-4611-87a4-d47f90911790 service neutron] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:23:16.351378 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadd924-baf5-4719-b05c-eb328f5bacd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a1644fa5cd3499d9d6ad057067255e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:23:16.352008 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadd924-baf5-4719-b05c-eb328f5bacd4 service nova] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:23:16.352286 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadd924-baf5-4719-b05c-eb328f5bacd4 service nova] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:23:16.352558 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadd924-baf5-4719-b05c-eb328f5bacd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:23:16.354566 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1cadd924-baf5-4719-b05c-eb328f5bacd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:23:16.366775 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadd924-baf5-4719-b05c-eb328f5bacd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:23:16.368376 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadd924-baf5-4719-b05c-eb328f5bacd4 service nova] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:23:16.379897 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1479/2917] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:23:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 14:23:16.957685 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=34 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:23:20.833534 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5f17-2dd8-49e0-b6f5-8a8e5be0f828 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:23:20.842511 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd5f17-2dd8-49e0-b6f5-8a8e5be0f828 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:23:20.846111 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4952e-2f28-4c70-86ce-a5a152762306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7afc19dc502f425faf693eb963fe63d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:23:20.846742 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4952e-2f28-4c70-86ce-a5a152762306 service neutron] REQUEST_METHOD: `GET` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:23:20.847076 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4952e-2f28-4c70-86ce-a5a152762306 service neutron] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:23:20.847349 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4952e-2f28-4c70-86ce-a5a152762306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:23:20.849073 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-5be4952e-2f28-4c70-86ce-a5a152762306 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:23:20.933911 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4952e-2f28-4c70-86ce-a5a152762306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:23:20.935923 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4952e-2f28-4c70-86ce-a5a152762306 service neutron] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:23:20.954364 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1439/2918] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:23:26.375923 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=6 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:23:28.016453 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadd924-baf5-4719-b05c-eb328f5bacd4 service nova] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:23:28.021193 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-1cadd924-baf5-4719-b05c-eb328f5bacd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:23:28.032389 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadd924-baf5-4719-b05c-eb328f5bacd4 service nova] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:23:28.036927 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:23:28.037795 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:23:28.038100 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:23:28.038371 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] PATH_INFO: `/v3/users/e890043baf574e4aaf50d1aed8a9f08a` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:23:28.039561 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e890043baf574e4aaf50d1aed8a9f08a)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:23:28.041508 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:23:28.319953 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e890043baf574e4aaf50d1aed8a9f08a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:28.320653 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e890043baf574e4aaf50d1aed8a9f08a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:28.321256 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e890043baf574e4aaf50d1aed8a9f08a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:28.386161 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e890043baf574e4aaf50d1aed8a9f08a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:28.394243 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e890043baf574e4aaf50d1aed8a9f08a'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:28.412116 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1480/2919] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:23:28 2022] DELETE /identity/v3/users/e890043baf574e4aaf50d1aed8a9f08a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:23:28.651276 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4952e-2f28-4c70-86ce-a5a152762306 service neutron] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:23:28.661848 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4952e-2f28-4c70-86ce-a5a152762306 service neutron] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:23:28.727156 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:23:28.728120 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:23:28.728401 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:23:28.728707 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] PATH_INFO: `/v3/projects/86d3340824834147bc04e447ba9275f9` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:23:28.730242 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d3340824834147bc04e447ba9275f9)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:23:28.732437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:23:28.877793 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d3340824834147bc04e447ba9275f9', 'request_id': 'req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:28.883924 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d3340824834147bc04e447ba9275f9', 'request_id': 'req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:28.891494 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d3340824834147bc04e447ba9275f9', 'request_id': 'req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:28.895128 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:23:28.957184 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] The token cache is being invalidate because project 86d3340824834147bc04e447ba9275f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:23:28.957619 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:28.958236 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:28.959819 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1440/2920] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:23:28 2022] DELETE /identity/v3/projects/86d3340824834147bc04e447ba9275f9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:23:28.963773 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:23:28.965166 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:23:28.978245 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2defdd-81ea-4359-b6f2-080e85f17f89 admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:23:29.034536 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:23:29.035464 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:23:29.035744 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:23:29.036015 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] PATH_INFO: `/v3/users/54b1dac98dae49f3ab1f47e8265b46af` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:23:29.037197 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b1dac98dae49f3ab1f47e8265b46af)` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:23:29.039159 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:23:29.234480 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b1dac98dae49f3ab1f47e8265b46af'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:29.235377 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b1dac98dae49f3ab1f47e8265b46af'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:29.235860 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b1dac98dae49f3ab1f47e8265b46af'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:29.316938 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b1dac98dae49f3ab1f47e8265b46af'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:29.324232 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.notifications [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b1dac98dae49f3ab1f47e8265b46af'} {{(pid=92064) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:29.332121 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:23:29.342678 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1481/2921] 10.222.0.42 () {58 vars in 1223 bytes} [Fri May 27 14:23:28 2022] DELETE /identity/v3/users/54b1dac98dae49f3ab1f47e8265b46af => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:23:29.600088 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] Authenticating user token {{(pid=92065) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:23:29.601539 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.fernet_utils [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92065) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:23:29.616858 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ea983-5ea8-4a5a-94da-ef5ccbc6e9e6 admin admin] Validating token access rules against request {{(pid=92065) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:23:29.684483 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4343916bc48d4b1596f21b7dfce5ddf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72e15fb71aa4010bb48da49b133708a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92065) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:23:29.685720 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:23:29.686067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:23:29.686067 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] PATH_INFO: `/v3/projects/38c2be6161154fa8a7c03c62fa13ab19` {{(pid=92065) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:23:29.687730 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c2be6161154fa8a7c03c62fa13ab19)` {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:23:29.689724 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] RBAC: Authorization granted {{(pid=92065) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:23:29.858437 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c2be6161154fa8a7c03c62fa13ab19', 'request_id': 'req-e6f489ae-8ecb-42c7-b014-f12e5e119c04'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:29.864414 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c2be6161154fa8a7c03c62fa13ab19', 'request_id': 'req-e6f489ae-8ecb-42c7-b014-f12e5e119c04'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:29.871413 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c2be6161154fa8a7c03c62fa13ab19', 'request_id': 'req-e6f489ae-8ecb-42c7-b014-f12e5e119c04'} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:29.934904 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] The token cache is being invalidate because project 38c2be6161154fa8a7c03c62fa13ab19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92065) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 14:23:29.935221 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:29.936442 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG keystone.notifications [None req-e6f489ae-8ecb-42c7-b014-f12e5e119c04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92065) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 14:23:29.938065 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: [pid: 92065|app: 0|req: 1441/2922] 10.222.0.42 () {58 vars in 1232 bytes} [Fri May 27 14:23:29 2022] DELETE /identity/v3/projects/38c2be6161154fa8a7c03c62fa13ab19 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 14:23:39.512153 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:23:39.931489 dv-cinder-843018-4-iscsi devstack@keystone.service[92065]: DEBUG dbcounter [-] [92065] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 14:25:27.573401 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] Authenticating user token {{(pid=92064) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 14:25:27.574830 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:25:27.667637 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e98623-9bff-40b1-9da9-2bf8866ccabf admin admin] Validating token access rules against request {{(pid=92064) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 14:25:27.726155 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be2778-a2ed-4645-a4d3-546dc745040a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6375aed65de46e19a9d3da583b42bbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1b672d903ec47fa925efeeda378fb7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92064) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 14:25:27.727119 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be2778-a2ed-4645-a4d3-546dc745040a service placement] REQUEST_METHOD: `GET` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 14:25:27.727412 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be2778-a2ed-4645-a4d3-546dc745040a service placement] SCRIPT_NAME: `/identity` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 14:25:27.727692 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be2778-a2ed-4645-a4d3-546dc745040a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92064) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 14:25:27.729479 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.fernet_utils [None req-35be2778-a2ed-4645-a4d3-546dc745040a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92064) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 14:25:27.740882 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be2778-a2ed-4645-a4d3-546dc745040a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 14:25:27.742819 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be2778-a2ed-4645-a4d3-546dc745040a service placement] RBAC: Authorization granted {{(pid=92064) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 14:25:27.752712 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: [pid: 92064|app: 0|req: 1482/2923] 10.222.0.42 () {60 vars in 1365 bytes} [Fri May 27 14:25:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 14:25:37.748496 dv-cinder-843018-4-iscsi devstack@keystone.service[92064]: DEBUG dbcounter [-] [92064] Writing DB stats keystone:SELECT=67 {{(pid=92064) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}